Databricks Architect

Job title: Databricks Architect with Healthcare Domain
Location: Remote
Mandatory Skills: Databricks,Delta Live Tables, Unity Catalog, Lakehouse Federation, Lakehouse Monitoring, Databricks Workflows,AWS,Python,Pyspark

Job Summary:

We are seeking a highly experienced Databricks Data Architect to lead the design and implementation of end-to-end data architecture and strategy on the Databricks platform. The ideal candidate will have deep hands-on expertise in Databricks, AWS data services, and strong exposure to the healthcare domain. This role requires strong solutioning capabilities, leadership experience, and technical fluency in Python and PySpark.

Key Responsibilities:

• Design and implement end-to-end data architecture and frameworks on Databricks.
• Develop and drive overall data strategy, including data flow design, quality frameworks, and workload management.
• Leverage Databricks capabilities such as:
  • Delta Live Tables
  • Unity Catalog
  • Lakehouse Federation
  • Lakehouse Monitoring
  • Databricks Workflows
• Define and implement data quality management, logging & auditing, and workload orchestration across Databricks workspaces.
• Work closely with cross-functional teams to ensure data operability, governance, and compliance.
• Architect database/data models and integrate with broader data analytics stack.
• Drive AWS-based implementations using services such as DMS (Data Migration Service), following industry best practices.
• Provide technical leadership and mentorship to engineering teams.
• Communicate and collaborate with stakeholders to define requirements and deliver scalable solutions.

Required Skills & Qualifications:

• 10+ years of experience in Data Architecture and Engineering.
• Proven expertise in Databricks platform with hands-on experience using:
  • Delta Live Tables
  • Unity Catalog
  • Lakehouse Federation
  • Monitoring & Workflows
• Strong understanding of data quality, auditing, logging, and workload management.
• Proficiency in Python and PySpark.
• Solid knowledge of AWS data services, especially DMS, and AWS implementation best practices.
• Deep understanding of data analytics stacks and data modeling techniques.
• Excellent communication and solutioning skills.
• Prior experience working in the healthcare domain is a must (Payer/Provider experience preferred).
• Proven leadership in driving architecture strategy and leading technical teams.
  
  
  
  Disclaimer: E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. We especially invite women, minorities, veterans, and individuals with disabilities to apply. EEO/AA/M/F/Vet/Disability."