Azure Data Engineer

Job Title: Senior Azure Data Engineer

Position Overview:
We are seeking a highly skilled and experienced Azure Data Engineer to support the design, development, and optimization of scalable data solutions on the Microsoft Azure platform. The ideal candidate will possess strong technical expertise in cloud-based data engineering, data integration, ETL/ELT pipelines, and modern Azure data services, along with a solid understanding of healthcare data systems, including Electronic Health Records (EHR).

Key Responsibilities:

·         Design, develop, and optimize scalable data pipelines and data solutions using Azure.

·         Build and maintain ETL/ELT pipelines using Azure Data Factory (ADF).

·         Develop data processing and transformation solutions using Azure Databricks, PySpark, and Python.

·         Work with Azure Synapse Analytics, Azure SQL Database, and Data Lake Storage Gen2.

·         Integrate data from multiple sources, including healthcare systems and EHR platforms.

·         Implement data quality, validation, governance, security, and monitoring processes.

·         Optimize data pipelines and queries for performance, scalability, and reliability.

·         Collaborate with data architects, analysts, application teams, and business stakeholders.

·         Develop solutions following Azure cloud architecture and best practices.

Required Skills:

·         Strong experience with Azure Data Engineering.

·         Hands-on experience with Azure Data Factory (ADF).

·         Strong knowledge of Azure Databricks, PySpark, and Python.

·         Experience with Azure Synapse Analytics.

·         Strong SQL skills and experience with Azure SQL.

·         Experience with Azure Data Lake Storage (ADLS Gen2).

·         Knowledge of ETL/ELT, data warehousing, and data modeling.

·         Experience working with large and complex datasets.

·         Understanding of healthcare data, EHR, HL7/FHIR, or related healthcare systems is preferred.

·         Experience with Git, CI/CD, Azure DevOps, and cloud deployment practices.

·         Strong understanding of data security, governance, and compliance.

·         Preferred Experience:

·         8+ years of overall data engineering experience.

·         5+ years of experience working with Microsoft Azure data services.

·         Experience developing enterprise-scale data platforms.

·         Healthcare/health insurance domain experience is highly preferred.

·         Experience with HIPAA-compliant data environments is a plus.