Data Engineer

  • Reston, VA
  • Posted 1 day ago | Updated moments ago

Overview

On Site
BASED ON EXPERIENCE
Full Time
Contract - Independent
Contract - W2
Contract - 12+ mo(s)

Skills

DATA ENGINEER
AWS
AZURE
DATA LAKE
DATALAKE
FREDDIE MAC
FANNIE MAE
CAPITAL ONE
SPARK
PYSPARK
CDC
DATA CAPTURE
ETL
AZURE
DATA BRICKS
APACHE
AIRFLOW

Job Details

Description:

15+ years of experience in data engineering
5+ years iof experience in designing scalable, cloud-native platforms using AWS, Azure,
Experience using Data Bricks is desired
Expert in implementing modern data architectures such as Data Lake, Delta Lake, Lakehouse, OneLake, and Data Mesh for real-time analytics and AI-driven insights.
Proven ability to optimize data integration pipelines (ETL/ELT), implementing Change Data Capture (CDC) for Analytics projects, and drive robust data governance.
Skilled in leveraging S3, Redshift, AWS Glue, EMR, Azure Data Lake, and Power BI to deliver secure, high-performance solutions and self-service BI ecosystems.
Skilled in leveraging Apache Airflow, Apache Flink and other Data tools
Experienced in distributed data compute architecture using Apache Spark and PySpark.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.