Senior Azure Data Engineer

Responsibilities

• Design, develop, and maintain scalable data pipelines and data integration solutions.
• Build and optimize enterprise data platforms using Azure technologies.
• Develop and support batch and near real-time data processing solutions.
• Create and maintain technical documentation, process flows, and data mappings.
• Design secure and efficient data architectures aligned with organizational standards.
• Develop reusable frameworks and automation to improve data delivery and quality.
• Implement CI/CD pipelines and DevOps best practices for data engineering workloads.
• Perform code reviews and establish development standards.
• Mentor junior engineers and provide technical leadership.
• Troubleshoot data issues and perform root cause analysis.
• Collaborate with business and technical stakeholders to translate requirements into solutions.
• Integrate data from multiple internal and external sources, including APIs.
• Evaluate emerging technologies and recommend improvements to existing processes.

Required Qualifications

• 6+ years of experience in data engineering and cloud-based data platforms.
• Hands-on experience with:
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics
  • Azure Data Lake Storage
  • Azure Databricks
  • Azure DevOps
• Strong programming skills in:
  • Python
  • SQL/T-SQL
  • JSON/XML
• Experience building and optimizing ETL/ELT pipelines.
• Experience with CI/CD pipeline creation and automation.
• Knowledge of relational databases such as SQL Server.
• Familiarity with NoSQL databases such as MongoDB or similar technologies.
• Experience consuming REST APIs.
• Understanding of Agile development methodologies.

Preferred Qualifications

• Experience working with healthcare datasets.
• Experience with Spark or distributed processing frameworks.
• Exposure to cloud orchestration and infrastructure automation.
• Prior experience mentoring or leading other engineers.