Job Title: Databricks Administrator
Location: Austin, Texas - Onsite
Interview Mode: In Person only(no exceptions)
Job Summary
We are seeking an experienced Databricks Administrator to manage, configure, and support the Databricks platform in a cloud environment. This role is responsible for enabling scalable data engineering, analytics, and AI/ML workloads while ensuring platform reliability, security, cost optimization, and compliance.
The ideal candidate will oversee workspace configuration, cluster management, access controls, and integrations with cloud services, while supporting data engineers, analysts, and data scientists across the organization.
Key Responsibilities
- Administer and manage Databricks workspaces in a cloud environment (AWS preferred)
- Configure and optimize clusters, job scheduling, and workspace settings
- Manage user access, roles, and permissions using IAM, SCIM, and RBAC
- Implement and enforce cluster policies and governance standards
- Integrate Databricks with cloud storage solutions (e.g., S3)
- Monitor platform health, performance, and availability
- Perform troubleshooting and performance tuning using Apache Spark concepts
- Support Databricks SQL, notebooks, and job orchestration workflows
- Ensure data security, encryption, and compliance standards are maintained
- Automate processes using DevOps tools such as Terraform and CI/CD pipelines
- Collaborate with data engineering, analytics, and ML teams to support workloads
Required Qualifications
- 8+ years of experience in Databricks administration in cloud environments
- Strong knowledge of Databricks cluster configuration and workspace management
- Experience managing access controls using IAM, SCIM, and RBAC
- Proficiency in Apache Spark, including performance tuning and troubleshooting
- Experience integrating Databricks with cloud storage (e.g., S3)
- Strong understanding of platform monitoring, performance, and reliability
- Knowledge of data security, encryption, and compliance best practices
- Experience with DevOps/automation tools (Terraform, CI/CD, scripting)
Preferred Qualifications
- Experience administering Databricks in enterprise environments
- Familiarity with Unity Catalog for governance and access control
- Experience with cost management and optimization for Databricks workloads
- Experience supporting AI/ML workloads using Databricks ML and MLflow
- Understanding of data lake and lakehouse architectures
- Proficiency in Python, SQL, or Scala
Never miss an opportunity! Create an alert based on the job you applied for.
