Sr. Data Pipeline Engineer

Overview

Remote
$50 - $60
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
No Travel Required

Skills

Data Engineering
Data Integration
Data Modeling
Databricks
Design Patterns
Docker
ELT
Extract
Transform
Load
Health Care
Kubernetes
Microsoft Azure
Microsoft SQL Server
Normalization
Optimization
Performance Management
Performance Tuning
Preventive Maintenance
Project Management
PySpark
Python
SQL
SQL Azure
Virtual Machines
Workflow

Job Details

Sr. Data Pipeline Engineer

Temp to Hire

100% offsite - 8am-5pm EST

Visa: EAD/ USC

The Sr. Data Pipeline Engineer brings years of enterprise data engineering experience with deep proficiency in Databricks development using Python and SQL/PySpark, complemented by strong expertise across the Azure SQL Server ecosystem including Managed Instances, Azure SQL DB, and SQL Server VMs. They should demonstrate solid grounding in data modeling principles and ETL/ELT design patterns, with hands-on experience leveraging Docker and Azure Kubernetes Service for automation workflows. A proven track record in performance optimization and building scalable data solutions is essential. Healthcare data integration experience is strongly preferred, particularly with large-scale data harmonization and normalization initiatives.

 

Skills: -

  • Databricks (Python and SQL/PySpark)
  • Azure SQL Server (Managed Instance, Azure SQL DB, SQL Server VMs)
  • Data modeling and ETL/ELT design patterns
  • Docker and Azure Kubernetes Service (AKS) for select automation
  • Performance optimization and scalability

Experience: -

  • 7+ years enterprise data engineering
  • Healthcare data integration experience strongly preferred
  • Experience with large-scale data harmonization and normalization

Education

  • Bachelors Degree or equivalent experience.
  • Healthcare experience preferred.

Ideal Candidate

  • Highly technical senior engineer
  • Comfortable optimizing performance and automating workflows
  • Able to design durable, scalable pipelines and proactively identify issues
  • Skilled at balancing ongoing production workload with new feature development
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.