Databricks Architect

Overview

On Site
Accepts corp to corp applications
Contract - Independent
Contract - W2

Skills

Real-time
Storage
Data Security
Encryption
Auditing
Data Architecture
Cost Management
Migration
Database
SQL Azure
Collaboration
Operational Excellence
Unity
Databricks
SQL
Microsoft Azure
IaaS
PaaS
Computer Networking
Data Governance
Python
Regulatory Compliance
Optimization
Cloud Computing

Job Details

Seeking a strong Solution Architect with proven experience in designing and implementing end-to-end data solutions on Azure Databricks, leveraging the Lakehouse architecture and modern data governance practices.

Key Responsibilities:

  • Design and implement scalable, secure, and cost-optimized Databricks Lakehouse solutions.

  • Configure and administer Databricks clusters, Unity Catalog, and related governance frameworks.

  • Develop and optimize data pipelines (batch and real-time) using Delta Lake, MLflow, and Databricks SQL.

  • Define landing zone architectures, including networking, storage hierarchy, and workspace setup.

  • Implement data security and compliance controls for PII/PHI, encryption, and audit requirements.

  • Provide technical guidance on data architecture strategy, sizing, autoscaling, and cost management.

  • Lead migration of on-prem databases to Azure SQL-based services.

  • Collaborate with cross-functional teams to enforce best practices and operational excellence.


Required Skills:

  • Hands-on experience with Databricks Medallion architecture, Unity Catalog, MLflow, Delta Lake, and Databricks SQL.

  • Strong Azure cloud (IaaS, PaaS) and networking knowledge.

  • Expertise in data governance, lineage, and centralized cataloging.

  • Proficient in Python programming and data frameworks.

  • Excellent understanding of security, compliance, and cost optimization in cloud data environments.


Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.