Databricks Platform Engineer

Hiring : Databricks Platform Manager / Engineer - AWS

Location: New York / Hybrid

Experience: 5-10 years overall | 3-5+ years hands-on Databricks platform experience

Environment: AWS | Databricks | Terraform | CI/CD

We’re looking for a Databricks Platform Manager / Engineer who knows how to build, secure, automate, and keep an enterprise Databricks platform running smoothly in production.

This is platform engineering - not a data engineering or analytics development role.

What you’ll be responsible for:

Design, deploy, administer, and support Databricks workspaces across Dev, Test, UAT & Production

Manage Databricks Runtime upgrades, workspace standards, clusters, instance pools & cluster policies

Administer Unity Catalog, RBAC, IAM, SSO, Service Principals, PATs & Secret Scopes

Build and maintain secure, scalable AWS infrastructure and networking

Implement Terraform / Infrastructure as Code and CI/CD automation

Integrate Git and support automated deployment of notebooks, workflows and infrastructure

Monitor platform health, performance, jobs, clusters and production incidents

Troubleshoot complex production issues and perform root-cause analysis

Drive Databricks and AWS cost optimization and resource utilization

Maintain audit logging, security controls, governance and compliance standards

We’re looking for experience with:

Databricks Platform Administration

AWS - IAM, VPC, S3, EC2, KMS, CloudWatch

Terraform / IaC

Git & CI/CD - Azure DevOps, GitHub Actions or Jenkins

Unity Catalog & Databricks governance

Cluster policies, instance pools & job clusters

Cloud networking, security, scalability & HA

Monitoring, incident management & production support

Performance and cost optimization

A strong platform/cloud engineer who can take ownership of the operational health, security, governance, automation, scalability and cost efficiency of an enterprise Databricks environment while working closely with Data Engineering, DevOps, Security and Analytics teams.

Interested? Send your updated resume to or message me directly.