Data Engineer

  • Richmond, VA
  • Posted 13 days ago | Updated 1 hour ago

Overview

On Site
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - Long Term

Skills

SQL
Python
agile
ETL
Terraform
Jenkins
EMR
GIT
PERFORMANCE TUNING
Continuous Integration/Delivery
Amazon Web Services
DEV OPS
Best Practices
Version Control
Data Quality
Process Automation
Data Services

Job Details

Data Engineer

Mclean, VA or Richmond, VA

Hybrid

Responsibilities:

Key Responsibilities:

Design, build, and optimize ETL pipelines using Python, PySpark, and Spark

Develop scalable data solutions leveraging Databricks, AWS Glue, EMR, and S3

Collaborate with cross-functional engineering and analytics teams to implement best practices in data ingestion, transformation, and storage

Support data quality, performance tuning, and process automation across the data lifecycle

Work in Agile environments with CI/CD and version control tools

Required Skills and Experience:

3 to 7 plus years of experience in data engineering, preferably in cloud-based environments

Strong proficiency in Python, PySpark, Spark, and SQL

Hands-on experience with AWS data services (S3, Glue, EMR, Redshift, Lambda, Athena)

Experience with Databricks or equivalent data lake platforms

Familiarity with modern DevOps practices (Git, Jenkins, Terraform, Airflow, etc.)

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Merican Inc