Job Title: Senior Azure Databrick Engineer Job Location: Onshore United States Remote, anyone from Pennsylvania area will be highly preferred.
Position Summary
Technology & Domain Expertise
Azure Databricks & PySpark
SQL & Data Warehousing
Delta Lake & Medallion Architecture
Azure Data Factory (ADF), ADLS & Unity Catalog
CI/CD, Git & Release Management
Healthcare Payer Data (Claims, Membership, Provider, Clinical)
Hands-on Senior Data Engineer to support enhancement, stabilization, and delivery of a large-scale healthcare data lake built on Azure Databricks. The role will drive development of scalable data pipelines, platform improvements, production issue remediation, and onboarding of new data products supporting interoperability, analytics, and regulatory use cases.
Key Responsibilities
Design, develop, and optimize data pipelines using Azure Databricks, PySpark, SQL, and Delta Lake.
Build and enhance Medallion Architecture Bronze and Silver layer data products.
Support platform enhancements, defect remediation, and production stabilization activities.
Collaborate with architects, product owners, QA, and business stakeholders to define and deliver solutions.
Perform root cause analysis and drive resolution of technical and data-related issues.
Support release planning, deployment activities, and production readiness.
Required Skills
7 to 8 years of Data Engineering experience.
Strong expertise in Azure Databricks, PySpark, SQL, ADLS, and Delta Lake.
Knowledge of Azure Data Factory, Unity Catalog, CI/CD, and GIT.
Experience with ETL/ELT development, data warehousing, and dimensional modeling.
Strong troubleshooting, performance tuning, and debugging capabilities.
Experience working in Agile delivery environments.
Excellent communication and stakeholder management skills.
Preferred Skills
Healthcare payer domain experience (Claims, Membership, Provider, Clinical and more).
Experience with FHIR/Interoperability data models.
Experience supporting enterprise-scale cloud data platforms has context menu
Never miss an opportunity! Create an alert based on the job you applied for.
