Senior Azure Data Engineer :: W2 Position :: Remote

Senior Azure Data Engineer--Remote

We are looking for a Senior Azure Data Engineer who specializes in healthcare data, (HL7 and FHIR standards) to design and implement ETL/ELT pipelines and ensure data quality across various systems. Will be working with the Payer to Payer API and integrations to EHR. There will also be some functional testing in this role.

• 8+ years of experience as a Data Engineer with a strong foundation in data analysis and data engineering principles.
• Proven expertise in Azure Data Factory (ADF) and related Azure technologies.
• Several years of experience as a SQL Developer, transitioning into a Data Engineering role.
• 5+ years of experience in healthcare data, including quality assurance, and working with HL7 and FHIR standards.
• Hands-on experience with EMR systems, especially EPIC (preferred); HL7 and FHIR experience is required.
• Designed and implemented ETL/ELT pipelines using raw XML and JSON data, integrating across multiple parallel data sources.
• Proficient in creating DDL scripts, database tables, and implementing complex logic for data transformation.
• Skilled in data validation, profiling, and Python scripting, with familiarity in handling diverse data formats (e.g., date formats).
• Experience working in various SQL development environments, including handling data arrays and using LATERAL joins for data decomposition.
• Strong understanding of the importance of data quality and its impact on downstream processes.

Desired Skills

• Extensive experience in automating web applications using Selenium WebDriver, with automation scripting in Python.
• Hands-on experience with Snowflake for data warehousing and analytics.
• Exposure to multiple testing domains including:
• Functional testing
• Data integrity
• Security and privacy validation
• Regression testing
• Ongoing data quality monitoring and tracking