Overview
Skills
Job Details
*NOTE: Locals as client wants candidate to attend in-person interview
*NOTE: Locals as client wants candidate to attend in-person interview
*NOTE: Locals as client wants candidate to attend in-person interview
Job Title: Senior Databricks Platform Administrator Location: Alpharetta, GA (Onsite) - Locals as Inperson interview Duration: 12+ Months Contract Note: Strong proficiency in Python, Terraform, and Azure/AWS required.
Position Overview
We are seeking a seasoned Databricks Platform Administrator to design, implement, and manage our enterprise-scale Databricks environment. This role is pivotal in ensuring the platform is secure, scalable, highly available, and optimized for performance and cost. You will work closely with data engineers, data scientists, and cloud architects to administer, automate, and govern the Databricks platform across development, QA, and production environments.
Key Responsibilities
Administer and manage the Databricks environment, including workspace configuration, user management, cluster policies, and job scheduling.
Develop and maintain Infrastructure as Code (IaC) using Terraform to automate the deployment and management of Databricks workspaces and associated cloud resources.
Implement and enforce security best practices, including RBAC, data encryption, network isolation, and audit logging via Unity Catalog.
Monitor platform health, performance, and usage, and implement observability solutions using Databricks-native tools, Prometheus, and Grafana.
Optimize and tune clusters, queries, and workflows for improved performance and cost-efficiency.
Establish and manage CI/CD pipelines for Databricks asset deployment using GitHub Actions or similar tools.
Collaborate with data teams to define and implement governance, compliance, and data management policies.
Provide operational support, troubleshooting, and incident resolution for the Databricks platform.
Required Qualifications
5+ years of experience in data platform administration, with a focus on Databricks.
Hands-on experience administering Databricks (workspaces, clusters, Unity Catalog, SQL Warehouses, Delta Lake).
Proficiency in Terraform for infrastructure automation and management.
Strong scripting skills in Python or Java for automation and tooling.
Experience with cloud infrastructure (Azure or AWS) in areas such as IAM, networking, storage, and monitoring.
Knowledge of CI/CD processes and tools like GitHub Actions, GitLab CI, or Jenkins.
Familiarity with monitoring and logging tools such as Prometheus, Grafana, or Datadog.
Excellent communication skills and experience working in cross-functional teams.
Preferred Qualifications
Databricks Certification (e.g., Databricks Certified Associate Administrator).
Experience in regulated industries such as finance or healthcare.
Knowledge of Databricks REST APIs and SDKs for extensibility and automation.
Azure or AWS certifications.
Experience with Linux administration and troubleshooting.