Sr. Data Pipeline Engineer

  • Posted 3 hours ago | Updated 3 hours ago

Overview

Remote
$55 - $65
Contract - Independent
Contract - 12 Month(s)

Skills

Data Engineering
Data Integration
Data Modeling
Databricks
Design Patterns
Docker
ELT
Extract
Transform
Load
Health Care
Performance Tuning
PySpark
Python
Kubernetes
Microsoft Azure
Microsoft SQL Server
Normalization
Optimization
SQL
SQL Azure
Virtual Machines
Workflow

Job Details

Role: Sr. Data Pipeline Engineer
Location: Remote
Job Description:
The Sr. Data Pipeline Engineer brings years of enterprise data engineering experience with deep proficiency in Databricks development using Python and SQL/PySpark, complemented by strong expertise across the Azure SQL Server ecosystem including Managed Instances, Azure SQL DB, and SQL Server VMs. They should demonstrate solid grounding in data modeling principles and ETL/ELT design patterns, with hands-on experience leveraging Docker and Azure Kubernetes Service for automation workflows. A proven track record in performance optimization and building scalable data solutions is essential. Healthcare data integration experience is strongly preferred, particularly with large-scale data harmonization and normalization initiatives.

Skills:

  • Databricks (Python and SQL/PySpark)
  • Azure SQL Server (Managed Instance, Azure SQL DB, SQL Server VMs)
  • Data modeling and ETL/ELT design patterns
  • Docker and Azure Kubernetes Service (AKS) for select automation
  • Performance optimization and scalability

Experience:

  • 7+ years enterprise data engineering
  • Healthcare data integration experience strongly preferred
  • Experience with large-scale data harmonization and normalization.

Education:

  • Bachelor s Degree or equivalent experience. Healthcare experience preferred.

Ideal Candidate

  • Highly technical senior engineer
  • Comfortable optimizing performance and automating workflows
  • Able to design durable, scalable pipelines and proactively identify issues
  • Skilled at balancing ongoing production workload with new feature development
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.