Role: Senior Databricks Platform Engineer Azure Cloud & Data Operations
100% Remote
Domain Focus: Databricks, Azure Cloud, Enterprise Data Platforms, Platform Engineering, DevOps Enablement
About the Opportunity
Our client is undergoing a large-scale enterprise modernization initiative focused on Azure-native infrastructure, platform engineering, automation, and modernization of data-intensive application ecosystems.
As part of this transformation, multiple calculation-heavy and operationally critical applications are being integrated into a growing Databricks-centered enterprise data platform spanning:
Azure cloud services
AKS and containerized platforms
GitHub and CI/CD ecosystems
enterprise automation and analytics environments
We are seeking a Senior Databricks Platform Engineer to support architecture, operational engineering, platform enablement, and modernization activities across this evolving environment.
This role blends:
Databricks platform expertise
cloud infrastructure awareness
DevOps-aligned engineering
operational platform support
The ideal candidate understands how Databricks workloads, APIs, pipelines, storage layers, and operational processes integrate within broader enterprise cloud ecosystems.
Key Responsibilities
Databricks Platform Engineering & Operations
Support architecture and operational engineering across enterprise Databricks environments
Design and maintain scalable Lakehouse, Delta Lake, and Unity Catalog solutions
Support administration of:
o Databricks Workspaces
o Jobs
o Notebooks
o Clusters
Optimize Spark workloads, cluster configurations, and platform performance
Support batch and streaming data processing workloads
Assist with multi-environment platform management across Dev, QA, and Production
Platform Integration & DevOps Alignment
Support integration of Databricks platforms with Azure-native ecosystems and enterprise applications
Work across integrations involving:
o APIs
o Azure Storage Accounts
o Data Lakes
o reporting and analytics platforms
Collaborate with platform and DevOps teams to align Databricks activities with existing CI/CD and automation standards
- Support deployment workflows utilizing:
o GitHub
o Azure DevOps
o Infrastructure as Code frameworks
Help ensure modernization activities do not disrupt existing automated deployment pipelines and operational processes
Governance, Reliability & Platform Support
Support governance, access management, monitoring, logging, and operational security practices
Assist with implementation of:
o RBAC
o lineage
o encryption
o platform governance controls
Participate in troubleshooting, operational support, and root cause analysis activities
Contribute to documentation, operational standards, and platform best practices
Required Qualifications
6+ years of experience within cloud, platform engineering, data engineering, or enterprise analytics ecosystems
3+ years of hands-on experience supporting enterprise Databricks environments
Strong experience with:
o Delta Lake
o Unity Catalog
o Spark workloads
o cluster operations
o Databricks Workspaces
- Experience with Azure cloud services and cloud-native platform concepts
- Familiarity with:
o Azure DevOps
o GitHub workflows
o CI/CD pipeline concepts
o deployment automation
Experience supporting APIs, distributed application integrations, and enterprise data platforms
Strong troubleshooting and operational support capabilities
Strong communication and stakeholder collaboration skills
Preferred Qualifications
o PySpark
o Python
o SQL
o Spark SQL
o Scala
o AKS/Kubernetes
o Terraform
o Bicep
o Infrastructure as Code practices
o Azure Data Lake
o Event Hub
o streaming architectures
o enterprise analytics environments
- Familiarity with monitoring and observability platforms such as:
o Azure Monitor
o Datadog
- Exposure to enterprise modernization and cloud migration initiatives
What This Role Is
A hands-on enterprise Databricks platform engineering role
A modernization-focused engineering opportunity within a large Azure ecosystem
A hybrid role spanning cloud integration, operational engineering, and DevOps-aware platform support
A collaborative engineering role supporting scalable enterprise data and analytics platforms
What This Role Is Not
A pure data scientist or analytics-only role
A narrowly scoped ETL development position
Never miss an opportunity! Create an alert based on the job you applied for.
