Azure Databricks Architect (SME)

Job Title: Azure Databricks Architect (SME)

Location: Remote

Duration: 12 Months

Experience: 15+ Years in IT (Mandatory)

Domain: Healthcare (Mandatory)

Job Summary

We are looking for a highly experienced Azure Databricks Architect (SME) to design, build, and optimize enterprise-scale data platforms in a Healthcare environment. The candidate must be an expert in Databricks architecture, performance optimization, governance, and cloud data engineering best practices.

Required Skills (Must-Have)

• Azure Databricks Architecture & Implementation
• Databricks Performance Tuning
• Bucketing & Salting Techniques
• Greenfield Databricks Implementations
• Delta Lake
• Medallion Architecture (Bronze / Silver / Gold)
• Databricks Governance
• Unity Catalog
• RBAC (Role-Based Access Control)
• Azure Data Factory (ADF)
• Delta Live Tables (DLT)
• Git & DevOps (CI/CD Pipelines)

Responsibilities

• Design and lead greenfield Azure Databricks architectures for large-scale Healthcare data platforms.
• Optimize Databricks workloads using performance tuning, bucketing, and salting strategies.
• Implement Medallion Architecture using Delta Lake and DLT.
• Define and enforce data governance, RBAC, and Unity Catalog standards.
• Integrate Databricks with ADF for orchestration and pipeline management.
• Establish Git-based version control and DevOps CI/CD pipelines.
• Act as an SME, guiding engineering teams and reviewing architectural designs.
• Ensure scalability, security, and compliance with healthcare data standards.