Data Engineer / Senior Data Engineer / Lead / Architect
Location: Irving, TX / Chicago, IL / Edina, MN / Philadelphia, PA / Portland, OR
Work Arrangement: Hybrid – 3 days onsite per week (Tuesday, Wednesday & Thursday)
Duration: Long-Term Contract
Important Note
Interested candidates are requested to include their LinkedIn profile URL/ID on their resume.
Must-Have Skills
- Azure Databricks
- Azure Data Lake Storage (ADLS Gen2)
- Azure Data Factory (ADF)
- PySpark
- Python
- SQL
- Delta Lake / Lakehouse Architecture
- ETL/ELT Development
- Data Modeling
- Azure Cloud Platform
- Git & CI/CD
- Agile/Scrum
Key Requirements
- 7+ years of experience in Data Engineering
- 5+ years of hands-on experience with Azure Data technologies
- 2+ years of experience in the Healthcare, Managed Care, or Payer domain
- Proven experience building enterprise-scale data pipelines and data integration solutions
- Strong understanding of Data Warehousing, Data Lakes, and Lakehouse architectures
- Hands-on experience processing large-scale structured and unstructured datasets
- Strong experience designing scalable and high-performance data solutions
Preferred Qualifications
- Experience working with healthcare data, including:
- Claims
- Membership
- Provider
- Care Management
- Power BI
- FHIR / HL7
- Azure DevOps & Infrastructure as Code (IaC)
- AI/ML data pipelines
Primary Responsibilities
- Design, develop, and optimize scalable ETL/ELT data pipelines
- Build data ingestion and transformation frameworks using Azure data services
- Develop scalable data processing solutions using Azure Databricks and PySpark
- Implement and maintain Delta Lake and Lakehouse architectures
- Develop data models to support analytics and business requirements
- Ensure data quality, governance, monitoring, security, and performance
- Troubleshoot and optimize data pipelines and processing workloads
- Support cloud migration, modernization, and data platform transformation initiatives
- Implement CI/CD practices for data engineering workflows
- Collaborate with business, analytics, product, and technology teams in Agile/Scrum environments
Ideal Candidate Profile
We are looking for a Senior Data Engineer / Lead / Architect with strong hands-on experience in Azure Databricks, ADF, ADLS Gen2, PySpark, Python, SQL, Delta Lake, and Lakehouse architecture, along with proven experience in the Healthcare/Managed Care/Payer domain.
Data Engineer/Senior Data Engineer/Lead/Architect1Snowflake,Azure,Data Engineer,adf,health OR Healthcare,DBT,Azure Data FacoryN/AC2CUnited States
