Databricks Architect
Seeking a Senior Databricks Platform Architect to lead secure, scalable Databricks deployments on AWS. This role requires hands-on infrastructure expertise combined with the ability to independently lead architecture and enablement sessions with large customer teams.
Here's what they're prioritizing:
1. Databricks Platform Architecture (Highest Priority)
- Designing, configuring, deploying, and securing Databricks on AWS
- Classic and serverless workspaces
- Platform security, workspace setup, cluster policies, identity/SSO, secret scopes, etc.
2. Terraform / DevOps
- Strong Terraform experience
- Infrastructure as Code (IaC)
- Infrastructure provisioning and deployment automation
3. AWS Infrastructure (Nice to Have)
- IAM, VPC, PrivateLink, networking, routing, etc.
- The client is looking for someone with working knowledge here, but they are not expecting an AWS networking specialist.
Key Responsibilities
Design and deploy Databricks classic and serverless workspaces on AWS, including networking, storage, and identity integration
Author and maintain Terraform modules to provision and manage AWS and Databricks resources in a repeatable, secure manner
Define and implement platform security architecture, including workspace isolation, cluster access controls, secrets management, and network security patterns
Lead architecture enablement sessions and workshops with large, cross-functional customer teams
Guide customer teams through Databricks security accreditation and compliance processes
Partner with customer cloud, security, network, and platform teams to validate architecture decisions and troubleshoot deployment issues
Produce clear architecture documentation, diagrams, and runbooks for platform configurations
Required Qualifications
10+ years of overall experience in cloud/data platform engineering or architecture
3–5 years of hands-on relevant experience with Databricks on AWS (classic and serverless workspace deployments)
Strong working knowledge of AWS infrastructure: S3, IAM, VPC design, and PrivateLink (both front-end and back-end connectivity)
Hands-on Terraform experience provisioning both AWS and Databricks resources
Solid understanding of Databricks platform security: workspace isolation, identity/SSO integration, cluster access controls, secret scopes, and network security patterns (e.g., private endpoints, security groups, network ACLs)
Excellent verbal and written communication skills, with demonstrated ability to independently lead technical sessions with large customer/stakeholder groups
Never miss an opportunity! Create an alert based on the job you applied for.