Overview
Remote
Depends on Experience
Contract - W2
Contract - Independent
Contract - 12 Month(s)
Skills
Azure
Architect
AI/ML
Machine Learning
Databricks
Medallion
MLFlow
Spark
Job Details
As an Azure Data Architect(AI/ML), you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards.
Educational Qualifications: -
- Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
- Technical certification in multiple technologies is desirable.
Mandatory skills
- Azure Databricks, Medallian architecture, Machine Learning, Spark.
Roles & Responsibilities: -
- Lead the architecture and implementation of scalable data pipelines using Apache Spark, Delta Lake, and Databricks Workflows.
- Design and optimize ETL/ELT processes for structured and unstructured data across cloud platforms (Azure, AWS, Google Cloud Platform).
- Collaborate with data scientists, analysts, and business stakeholders to deliver high-impact data solutions.
- Implement real-time streaming and batch processing using Structured Streaming and Delta Live Tables (DLT). Ensure data governance, lineage, and security compliance with standards such as HIPAA, GDPR, and SOC 2.
- Develop reusable frameworks and libraries to accelerate data engineering productivity.
- Mentor junior engineers and contribute to technical leadership across teams.
- Integrate MLflow and support deployment of Machine Learning models in production.
- Drive performance tuning and cost optimization of Spark workloads.
- Participate in strategic planning for data platform modernization and cloud migration.
- Azure Databricks and Medallian architecture.
- Azure Databricks & Apache Spark proficiency
- Python and SQL programming
- Cloud platform experience
- (Azure/AWS/Google Cloud Platform) ETL pipeline development
- Delta Lake implementation
- Healthcare data standards (HL7, FHIR, ICD-10) for healthcare-specific roles
- Data security and compliance knowledge.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.