Search Jobs | Dice.com

Job Details

Skills

Data Engineer
ETL

Summary

Role: Sr Data Engineer

Location: Remote

Duration: Long Term

Experience Level: 12+ Years

USA experience: 4 6 Years

Bachelor's or master s degree in Computer Science, Information Systems, or related field

Design data pipelines for API, streaming, and batch processing to facilitate data loads into the Snowflake data warehouse.
Collaborate with other engineering and DevOps team members to implement, test, deploy, and operate data pipelines and ETL solutions.
Develop scripts to Extract, Load and Transform data and other utility functions
Optimize data pipelines, ETL processes, and data integrations for large-scale data analytics use cases
Build necessary components to ensure data quality, monitoring, alerting, integrity, and governance standards are maintained in data processing workflows
Able to navigate ambiguity and thrives in a fast-paced environment. Takes initiative and consistently delivers results with minimal supervision.
7+ years of experience in building and maintaining data pipelines and ETL/ELT processes in data-centric organizations
Strong coding skills using Python. Familiar with Python libraries related to data engineering and cloud services including pandas, boto, etc.
At least 3 years of experience with AWS S3, SQS, Kinesis, Lambda, AWS DMS, Glue/EMR, AWS Batch or similar services.
Hands-on experience building streaming and batch big data data pipelines
Must have knowledge of building Infrastructure in AWS cloud using Cloud formation or Terraform
Experience on Anakonda and Jupyter Notebook
3+ years of working experience with Snowflake cloud data warehouse including Snowflake data shares, Snowpipes, Snow SQL, Tasks etc
Must have working knowledge of various databases, SQL and NoSQL
Must have working knowledge of various file formats like CSV, Json Avro, and Parquet.
Hands-on experience with cloud platforms such as AWS and Google Cloud.
Experience working with agile development methodology.
Experienced in CI/CD and release processes, proficient in Git or other source control management systems, to streamline development and deployment workflows

Other Desired Skills:

Minimum 5 years of designing and implementing operational production grade large-scale data pipelines, ETL/ELT and data integration solutions.
Exposure to multi-tenant/multi-customer environments is a big plus.
Hands on experience with productionized data ingestion and processing pipelines
Strong understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies.
Experience working with structured, semi-structured, and unstructured data.
Familiarity with MongoDB or similar NoSQL database systems.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10124308
Position Id: 9032336
Posted 2 hours ago

Fitment

Dice Job Match Score™

📊 Calculating match score...

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Data Engineer

Remote

•

Today

Solution IT Inc. is looking for a Senior Data Engineer for one of its clients Remote Job Title: Senior Data Engineer Required Skills Strong experience with Snowflake for cloud data warehousing, data modeling, performance optimization, and SQL development. Hands-on experience with Airflow for workflow orchestration, scheduling, monitoring, and management of data pipelines. Experience with ThoughtSpot for self-service analytics, reporting, dashboard development, and business intelligence solutio

Easy Apply

Contract, Third Party

Sr. Data Engineer

Remote

•

6d ago

Sr. Data EngineerLocation: Remote / Telecommute Contract Length: 6 Reports To (Title): COO Widescope Consulting and ContractingJOB SUMMARY Widescope Consulting and Contracting is proud to serve our nations military and Veterans. We support federal agencies in advancing the United States health care system and improving the overall health and well-being of those who serve or have served our country. Our health services are designed to help people live healthier lives. Accordingly, Widescope is s

Easy Apply

Full-time

100,000 - 125,000

Data Engineer

Remote or Detroit, Michigan

•

Today

Job Title: Data Engineer Location: (Detroit, MI, St. Louis, MO, Philadelphia, PA, Wilmington, DE, Columbus, OH, Chicago, IL, Minneapolis, MN.) Contact: 12+ Months Looking for W2 candidates. No C2C Job Summary: We are seeking an experienced Data Engineer to join our team in Chicago, IL. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and modern data infrastructure to support business intelligence, analytics, and machine learning initi

Contract

$DOE

Senior Data Engineer

Remote or Minnetonka, Minnesota

•

Today

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us adv

Full-time

USD 91,700.00 - 163,700.00 per year

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Sr Data Engineer

Skills

Summary

Dice Job Match Score™

Similar Jobs

Sr Data Engineer

Job Details

Skills

Summary

Dice Job Match Score™

Similar Jobs