Overview
On Site
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - months contract
Skills
Data Engineer
AWS
snowflake
PYSPARK
Job Details
Data Engineer
McLean, VA - Oniste
12 months contract
Job Summary
We are looking for an experienced Data Engineer with strong expertise in Snowflake, PySpark, and AWS to design and implement scalable data solutions. The ideal candidate will be responsible for building robust data pipelines, optimizing data workflows, and enabling advanced analytics by ensuring seamless integration across various data platforms.
Key Responsibilities
- Design, develop, and maintain ETL/ELT pipelines using PySpark and AWS services.
- Work with Snowflake to design efficient schemas, optimize queries, and manage large-scale datasets.
- Develop scalable and reliable data ingestion and transformation workflows.
- Collaborate with data analysts, scientists, and business stakeholders to deliver high-quality data solutions.
- Implement best practices for data governance, security, and performance tuning.
- Monitor, troubleshoot, and optimize data pipelines for performance and cost efficiency.
- Support migration and integration of data from legacy systems to Snowflake on AWS.
Required Skills & Qualifications
- Strong hands-on experience with Snowflake (data modeling, query optimization, Snowpipe, tasks, streams).
- Proficiency in PySpark for large-scale data processing and transformations.
- In-depth knowledge of AWS cloud services (S3, Glue, Lambda, EMR, Redshift, EC2, IAM).
- Strong SQL skills and experience with performance tuning in Snowflake/relational databases.
- Experience building and managing data pipelines in production environments.
- Familiarity with CI/CD pipelines and version control (Git).
- Excellent problem-solving, analytical, and communication skills.
Preferred Qualifications
- Experience with orchestration tools (Airflow, Step Functions, or similar).
- Exposure to data lake and data warehouse architectures.
- Knowledge of Python for automation and scripting.
- Experience with Agile/Scrum methodologies.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.