Remote- Databricks Architect

Databricks Architect

Seeking a Senior Databricks Platform Architect to lead secure, scalable Databricks deployments on AWS. This role requires hands-on infrastructure expertise combined with the ability to independently lead architecture and enablement sessions with large customer teams.

Here's what they're prioritizing:

1. Databricks Platform Architecture (Highest Priority)

• Designing, configuring, deploying, and securing Databricks on AWS
• Classic and serverless workspaces
• Platform security, workspace setup, cluster policies, identity/SSO, secret scopes, etc.

2. Terraform / DevOps

• Strong Terraform experience
• Infrastructure as Code (IaC)
• Infrastructure provisioning and deployment automation

3. AWS Infrastructure (Nice to Have)

• IAM, VPC, PrivateLink, networking, routing, etc.
• The client is looking for someone with working knowledge here, but they are not expecting an AWS networking specialist.

Key Responsibilities

Design and deploy Databricks classic and serverless workspaces on AWS, including networking, storage, and identity integration

Author and maintain Terraform modules to provision and manage AWS and Databricks resources in a repeatable, secure manner

Define and implement platform security architecture, including workspace isolation, cluster access controls, secrets management, and network security patterns

Lead architecture enablement sessions and workshops with large, cross-functional customer teams

Guide customer teams through Databricks security accreditation and compliance processes

Partner with customer cloud, security, network, and platform teams to validate architecture decisions and troubleshoot deployment issues

Produce clear architecture documentation, diagrams, and runbooks for platform configurations

Required Qualifications

10+ years of overall experience in cloud/data platform engineering or architecture

3–5 years of hands-on relevant experience with Databricks on AWS (classic and serverless workspace deployments)

Strong working knowledge of AWS infrastructure: S3, IAM, VPC design, and PrivateLink (both front-end and back-end connectivity)

Hands-on Terraform experience provisioning both AWS and Databricks resources

Solid understanding of Databricks platform security: workspace isolation, identity/SSO integration, cluster access controls, secret scopes, and network security patterns (e.g., private endpoints, security groups, network ACLs)

Excellent verbal and written communication skills, with demonstrated ability to independently lead technical sessions with large customer/stakeholder groups