Overview
On Site
Depends on Experience
Contract - Independent
Contract - W2
Contract - 1 Year(s)
Skills
Agile
Amazon Web Services
Apache Hadoop
Apache Spark
Cloud Computing
Collaboration
Conflict Resolution
Data Engineering
Data Modeling
Data Processing
Data Quality
Data Warehouse
Debugging
Distributed Computing
ELT
Electronic Health Record (EHR)
Extract
Transform
Load
Kubernetes
Management
Performance Tuning
Problem Solving
PySpark
Python
Query Optimization
Snow Flake Schema
Sprint
UPS
Workflow
Job Details
Job Description
- The Client is seeking highly skilled Data Engineers to join the team. The ideal candidates will have strong expertise in modern data engineering tools and cloud technologies, with proven hands-on experience in Python, PySpark, Snowflake, EMR, and EKS.
Responsibilities:
- Design, build, and optimize scalable data pipelines for large-scale data processing.
- Develop and maintain ETL/ELT workflows using Python and PySpark.
- Implement and manage data solutions on Snowflake and AWS services such as EMR and EKS.
- Ensure data quality, reliability, and availability across systems.
- Collaborate with data scientists, analysts, and business stakeholders to deliver efficient data solutions.
- Monitor, troubleshoot, and optimize data pipelines for performance and cost efficiency.
- Work in an agile environment, contributing to sprint planning, daily stand-ups, and retrospectives.
Required Skills & Experience:
- 3 6+ years of hands-on experience in data engineering.
- Strong proficiency in Python and distributed computing with PySpark.
- Deep understanding and practical knowledge of Snowflake (data modeling, performance tuning, query optimization).
- Hands-on experience with AWS EMR (Spark/Hadoop clusters) and EKS (Kubernetes on AWS).
- Solid understanding of data warehousing, data lakes, and ETL best practices.
- Strong problem-solving and debugging skills in large-scale data environments.
- Experience working in agile delivery models.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.