Technology Lead Databricks Administration (Azure/AWS)
Job Title: Technology Lead Databricks Administration
Location: Richardson, TX 75082 (100% Onsite)
Duration: 6 Months Contract
Start Date: June 2026
Interview: Face-to-Face Required
Position Overview
We are seeking a highly experienced Databricks Administration Lead / Cloud Platform SME to manage and support enterprise Databricks environments across Azure and AWS. The ideal candidate will possess strong expertise in Databricks platform administration, security governance, cloud infrastructure, automation, networking, and operational support.
This role will be responsible for platform administration, security management, incident resolution, cloud cost optimization, new platform integrations, migration initiatives, and governance activities. The candidate will serve as the Databricks Subject Matter Expert (SME) and work closely with data engineering, architecture, security, and business teams to ensure platform reliability, scalability, and compliance.
Required Qualifications
- 10+ years of overall IT Infrastructure, Cloud, and Platform Operations experience.
- 5+ years of Databricks Administration experience.
- Strong experience supporting enterprise Databricks environments.
- Expertise in Azure and/or AWS cloud platforms.
- Experience managing large-scale data and analytics platforms.
- Strong understanding of cloud security, governance, networking, and automation.
- Experience supporting production incidents and operational excellence initiatives.
Must-Have Skills
Databricks Administration
- Databricks Workspace Administration
- Cluster Management
- Job Administration
- Workspace Provisioning
- User & Group Management
- Platform Governance
- Platform Monitoring
- Platform Upgrades
- Incident Management
- Operational Support
Databricks Platform Expertise
- Apache Spark
- Delta Lake
- Databricks Workflows
- Databricks Security
- Unity Catalog
- Data Access Controls
- Data Governance
- Performance Optimization
Cloud Platforms
- Microsoft Azure
- Amazon Web Services (AWS)
- Multi-Cloud Operations
Core Technical Skills
Databricks & Big Data
- Databricks Administration
- Apache Spark
- Delta Lake
- Structured Streaming
- Data Pipelines
- Batch Processing
- Real-Time Data Processing
- Kafka Integration
- Data Engineering Platforms
Security & Governance
- Unity Catalog
- Role-Based Access Control (RBAC)
- Data Classification
- Data Masking
- Data Governance
- Security Audits
- Compliance Controls
- Identity & Access Management
Cloud Infrastructure
- Azure Databricks
- AWS Databricks
- Kubernetes
- Containers
- Serverless Architecture
- Virtual Networks
- Load Balancers
- DNS
- Firewalls
- Network Security Groups
DevOps & Automation
- Terraform
- Ansible
- PowerShell
- Python
- Infrastructure as Code (IaC)
- CI/CD Pipelines
- Automated Provisioning
FinOps & Cost Optimization
- Cloud Cost Governance
- Usage Analytics
- Cost Monitoring
- Budget Planning
- Resource Optimization
- Capacity Planning
- Multi-Cloud Cost Management
Key Responsibilities
Databricks Platform Administration
- Manage and administer enterprise Databricks environments.
- Configure clusters, workspaces, user access, and platform settings.
- Ensure platform availability, scalability, and reliability.
Security & Governance
- Define and implement Databricks security policies.
- Manage Unity Catalog, access controls, and governance frameworks.
- Support compliance and audit readiness initiatives.
Incident Management & Support
- Lead incident response and resolution activities.
- Perform root cause analysis and implement preventive measures.
- Support production operations and platform stability.
Cloud Platform Operations
- Manage Azure/AWS infrastructure supporting Databricks workloads.
- Maintain networking, security, monitoring, and operational processes.
- Support platform migrations and modernization initiatives.
Automation & Infrastructure as Code
- Develop and maintain Terraform and Ansible automation.
- Implement automated provisioning and configuration management.
- Improve operational efficiency through scripting and automation.
Advisory & Leadership
- Serve as Databricks Subject Matter Expert.
- Guide engineering teams on best practices and platform optimization.
- Mentor junior engineers and support platform adoption strategies.
Preferred Qualifications
- Databricks Certified Professional.
- Azure Administrator Associate.
- Azure Solutions Architect Expert.
- AWS Solutions Architect.
- AWS SysOps Administrator.
- Kubernetes Certifications.
- Experience with MLflow and Databricks AI/ML capabilities.
- Experience in large enterprise data platforms.
Top 3 Responsibilities
1. Databricks Platform Administration
- Workspace administration
- Cluster management
- Platform maintenance
- User onboarding and governance
2. Security Management
- Unity Catalog administration
- Access control management
- Security policy implementation
- Compliance support
3. Incident Resolution & Operational Support
- Production support
- Root cause analysis
- Platform performance tuning
- Operational stability
Never miss an opportunity! Create an alert based on the job you applied for.