Data Pipeline Engineer

Washington, DC, US • Posted 13 hours ago • Updated 1 hour ago
Contract W2
On-site
Company Branding Image
Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

  • Data Pipeline Engineer

Summary



ONSITE 4 DAYS A WEEK IN WASHINGTON, D.C.


Background and Context
The Data Engineer in this role will support programs involving one or more of the following:



  • Focuses explicitly on the one-time and phased mass migration efforts, ensuring zero data loss, strict adherence to mapping rules, and the successful execution of technical cutover protocols.



2. Scope of Work
2.1 Pipeline Development and Implementation



  • Build automated ETL/ELT pipelines to extract legacy data (Oracle, SharePoint) and load it into AWS RDS and Azure ADLS Gen2.

  • Program data cleansing, standardization, and validation logic into the pipelines based on the Data Quality Rulebook.

  • Execute the physical data extraction and load during pre-production and production cutovers.


2.2 Solution Design and Optimization



  • Tune extraction queries to minimize performance impacts on legacy production systems during sync operations.

  • Implement physical data models for the target databases.

  • Code and automate the technical rollback mechanisms and data reconciliation scripts.


2.3 Stakeholder Engagement and Change Management



  • Collaborate directly with the Business Analyst to interpret and implement STTM documents.

  • Provide feedback on technical feasibility and performance implications of proposed data transformation rules.

  • Participate in daily agile ceremonies and sprint planning.


2.4 Governance, Ethics, and Risk



  • Embed automated pre- and post-migration data quality checks directly into the ETL scripts.

  • Implement encryption standards at rest (AWS KMS) and in transit (TLS 1.2+).

  • Apply role-based access control (RBAC) schemas within the database layers via IAM and Microsoft Entra ID.


2.5 Documentation and Reporting



  • Document migration code repositories, operational runbooks, and cutover execution scripts.

  • Generate automated migration success/failure logs for auditing.



3. Required Qualifications and Experience
3.1 Education



  • Bachelor's or Master's in Computer Science, Data Engineering, or a related quantitative field.


3.2 Certifications (Preferred)



  • AWS Certified Data Engineer - Associate or Microsoft Certified Azure Data Engineer.


3.3 Mandatory Experience



  • 5+ years building ETL pipelines, with heavy emphasis on one-time mass data migrations from legacy relational databases.


3.4 Technical Knowledge



  • Expert SQL and Python.

  • Hands-on experience with database migration tools (e.g., AWS DMS), Databricks, and legacy Oracle ecosystems.


3.5 Core Competencies



  • Rigorous attention to detail regarding data integrity, strong problem-solving skills for schema mismatches, and ability to work under strict cutover deadlines.






Dexian stands at the forefront of Talent + Technology solutions with a presence spanning more than 70 locations worldwide and a team exceeding 10,000 professionals. As one of the largest technology and professional staffing companies and one of the largest minority-owned staffing companies in the United States, Dexian combines over 30 years of industry expertise with cutting-edge technologies to deliver comprehensive global services and support.

Dexian connects the right talent and the right technology with the right organizations to deliver trajectory-changing results that help everyone achieve their ambitions and goals. To learn more, please visit .

Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90560183
  • Position Id: 1009245-915
  • Posted 13 hours ago

Company Info

About Dexian DISYS

Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian’s platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.


Dexian’s brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions.

About_Company_OneAbout_Company_Two
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Washington, District of Columbia

Today

Easy Apply

Contract

Washington, District of Columbia

Today

Easy Apply

Contract

Washington, District of Columbia

Today

Easy Apply

Contract

Washington, District of Columbia

Today

Easy Apply

Full-time

$180000.00 - $180000.00 per annum

Search all similar jobs