Data Engineer

Overview

Remote
Hybrid
Depends on Experience
Contract - Independent
Contract - W2
Contract - 6 Month(s)

Skills

Data Engineer
ETL
ELT
Azure
Dataflows
SQL
Python
PySpark
Data Lake
Data Masking
Data Flow
Data Processing
Data Quality
DevOps
Agile
Management
JSON
Microsoft Azure
Scrum
Data Cleansing

Job Details

JOB DESCRIPTION:

Role: Data Engineer

Location: Remote - Richmond, VA

Duration: 6 Months

Interview: Face2Face Only

Work Arrangement: Remote

Agency Interview Type: In Person Only

Description:

Seeking a skilled data engineer with a minimum of 3 years experience to work with an existing software development team on an ongoing project.

This position will support the design and delivery of secure, scalable, and traceable data pipelines in Azure, with a focus on integrating and transforming sensitive, public-facing datasets. The candidate will build ingestion workflows and transformation logic to support reporting, analytics, and public transparency initiatives. This role requires experience with Azure-native tools, strong ETL/ELT capabilities, and a strong commitment to data quality, auditability, and responsible data use. The candidate will be working with an existing software development team in an Agile/Scrum environment.

Skill Required / Desired Amount of Experience

At least 3 years of experience building and maintaining ETL/ELT pipelines in enterprise environments using Azure-native tools Required 3 Years

Hands-on expertise with Azure Data Factory, Dataflows, Synapse Pipelines, or similar orchestration tools Required 3 Years

Proficiency in SQL, Python, or PySpark for transformation logic and data cleansing workflows Required 3 Years

Experience with Delta Lake, Azure Data Lake Storage Gen2, JSON, and Parquet formats - Required

3 Years

Ability to build modular, reusable pipeline components using metadata-driven approaches and robust error handling Required 3 Years

Familiarity with public data sources, government transparency datasets, and publishing workflows Required 3 Years

Knowledge of data masking, PII handling, and encryption techniques to manage sensitive data responsibly Required 3 Years

Experience with data quality frameworks, including automated validation, logging, and data reconciliation methods Required 3 Years

Strong grasp of DevOps/DataOps practices, including versioning, testing, and CI/CD for data pipelines Required 3 Years

Experience supporting data publishing for oversight, regulatory, or open data initiatives is highly desirable Required 3 Years

Certifications such as DP-203 (Azure Data Engineer Associate) or Azure Solutions Architect are a plus - Highly desired 3 Years

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.