Databricks Platform Architect

Databricks Platform Architect -

Jersey CIty,NJ

Key Responsibilities

• Design and deploy Databricks classic and serverless workspaces on AWS, including networking, storage, and identity integration
• Author and maintain Terraform modules to provision and manage AWS and Databricks resources in a repeatable, secure manner
• Define and implement platform security architecture, including workspace isolation, cluster access controls, secrets management, and network security patterns
• Lead architecture enablement sessions and workshops with large, cross-functional customer teams
• Guide customer teams through Databricks security accreditation and compliance processes
• Partner with customer cloud, security, network, and platform teams to validate architecture decisions and troubleshoot deployment issues
• Produce clear architecture documentation, diagrams, and runbooks for platform configurations

Required Qualifications

• 10+ years of experience in cloud infrastructure, data platform engineering, or platform architecture.
• 3–5+ years of hands-on experience designing, deploying, configuring, and securing Databricks on AWS, including classic and serverless workspaces. Strong experience with Databricks platform administration, workspace architecture, security configuration, and production deployments is required.
• Strong hands-on experience with Terraform and Infrastructure as Code (IaC) for provisioning and managing Databricks and AWS resources. Experience with CI/CD pipelines, infrastructure automation, deployment administration, and DevOps best practices is highly preferred.
• Proven experience designing and implementing Databricks platform security, including workspace isolation, identity/SSO integration, cluster access controls, secret scopes, and secure platform configuration.
• Demonstrated ability to independently lead architecture workshops, technical enablement sessions, and design reviews with customers and cross-functional stakeholders.
• Experience producing architecture documentation, platform diagrams, implementation guides, and operational runbooks.
• Working knowledge of AWS infrastructure and networking, including S3, IAM, VPCs, PrivateLink, load balancing, and networking concepts. Hands-on experience is preferred, but deep networking expertise is not required.
• Excellent verbal and written communication skills with the ability to partner effectively with cloud, networking, security, and platform engineering teams.

1. Databricks Platform Architecture (Highest Priority)

• Designing, configuring, deploying, and securing Databricks on AWS
• Classic and serverless workspaces
• Platform security, workspace setup, cluster policies, identity/SSO, secret scopes, etc.

2. Terraform / DevOps

• Strong Terraform experience
• Infrastructure as Code (IaC)
• Infrastructure provisioning and deployment automation

3. AWS Infrastructure (Nice to Have)

• IAM, VPC, PrivateLink, networking, routing, etc.
• The client is looking for someone with working knowledge here, but they are not expecting an AWS networking specialist.

The hiring manager mentioned the original JD was really a combination of a few different roles, so we''re narrowing the focus a bit. If you have candidates who are strong on the Databricks platform side and Terraform, don''t rule them out just because they aren''t experts in every AWS networking component.