Job Title: Data Engineer - Azure / Databricks
Job Type: Contract-to-Hire
Job Location: Hybrid / Remote
Overview
Seeking a high-performing Data Engineer to join a Pharmacy Data team within Data Operations / EIM. This role is critical to supporting pharmacy claims and related data pipelines as the organization continues its transition from on-prem systems to a modern Azure-based data platform.
This is a contract-to-hire opportunity focused on improving data quality, reliability, and engineering rigor. The ideal candidate will bring strong technical expertise, a proactive, detail-oriented mindset, and a high degree of ownership.
Team & Environment
The Pharmacy team supports data pipelines tied to pharmacy claims, rebates, and regulatory reporting. Data flows from external PBM/vendor systems into Azure and is processed for multiple downstream consumers, including member services, web applications, and actuarial teams.
The environment includes:
• Azure, including ADF, Databricks, and cloud data pipelines.
• Hybrid architecture, including cloud and legacy on-prem dependencies.
• Complex, high-volume healthcare data with evolving vendor formats.
Role Focus
• Build, maintain, and enhance cloud-based data pipelines.
• Ensure data quality, validation, and reliability across pharmacy datasets.
• Support evolving ingestion patterns and vendor data changes.
• Partner with business and product teams to deliver accurate, timely data.
Key Responsibilities
• Design and develop scalable data pipelines using Azure and Databricks.
• Ingest, transform, and validate pharmacy and claims-related data.
• Perform deep root-cause analysis on data issues, not just symptom fixes.
• Implement data quality checks, validation frameworks, and monitoring.
• Adapt pipelines to changing vendor file formats and ingestion cadences.
• Collaborate with product owners and stakeholders to translate business requirements into technical solutions.
• Troubleshoot production issues and ensure minimal downstream impact.
• Contribute to best practices around testing, deployment, and data engineering standards.
Day-to-Day Responsibilities
• Work within Databricks and Python to process incoming pharmacy data.
• Investigate data anomalies and identify root causes.
• Update pipelines to handle new vendor data structures or formats.
• Implement validation logic and proactive data quality controls.
• Collaborate with cross-functional teams on data-related issues.
• Support production pipelines and resolve incidents when needed.
Key Objectives
• Improve overall data quality and reliability across pharmacy systems.
• Reduce rework and downstream issues caused by insufficient validation.
• Build scalable, maintainable cloud-based data pipelines.
• Establish stronger engineering discipline around testing and validation.
• Support the broader cloud migration strategy.
Required Qualifications
• Bachelor's degree in Computer Science, Engineering, Data Science, or related field, or equivalent experience.
• 2+ years of hands-on data engineering experience.
• Strong Python experience.
• Strong SQL experience, such as PySpark SQL and relational databases.
• Experience with Azure Data Platform, including Databricks, ADF, or similar.
• Experience building and maintaining ETL/ELT pipelines.
• Strong troubleshooting and root-cause analysis skills.
• Experience working with large, complex datasets.
Preferred Qualifications
• Experience with healthcare, pharmacy, or PBM data.
• Familiarity with claims data, rebates, or regulatory datasets.
• Experience in hybrid environments, including on-prem and cloud.
• Exposure to tools such as Jira, ServiceNow, CI/CD pipelines, and Git.
• Experience with data validation frameworks and data quality tooling.
Key Traits for Success
• High ownership and accountability.
• Strong attention to detail and thoroughness in execution.
• Curious, analytical mindset with a focus on understanding data deeply.
• Ability to think through downstream impacts before implementing changes.
• Collaborative, but capable of working independently with minimal oversight.
• Avoids quick fixes and prioritizes long-term, scalable solutions.
Nice to Have
• Experience with Streamlit or similar tools for data exploration and visualization.
• Familiarity with health plan terminology, including in-network, out-of-network, and co-pay.
• Experience with pharmacy-specific workflows or PBM integrations.
Hours / Work Environment
• Monday-Friday, standard business hours.
• Hybrid or remote depending on candidate location and eligibility.
The projected hourly range for this position is $80 to $95.
On-Demand Group (ODG) provides employee benefits which includes healthcare, dental, and vision insurance. ODG is an equal opportunity employer that does not discriminate on the basis of race, color, religion, gender, sexual orientation, age, national origin, disability, or any other characteristic protected by law.
