Senior Databricks Administration

Title: Senior Databricks Administrator 

Location: Baltimore, MD / Evansville, IN

Need candidates local to Baltimore MD or Evansville IN - This is MANDATORY - NO RELOCATION.

We are seeking a Senior Databricks Administrator with 15+ years of overall IT experience and 5+ years of hands-on Databricks Administration experience to lead the administration, governance, security, performance, and cost optimization of an AWS Databricks platform.

This is a platform administration and governance role, not a development position. The ideal candidate will have extensive experience managing enterprise-scale Databricks environments on AWS and will be responsible for ensuring platform stability, security, compliance, performance, and operational excellence.

Key Requirements

15+ years of overall IT experience with 5+ years in Databricks Administration

• Strong hands-on expertise in:
• Databricks Workspace Administration
• Unity Catalog Administration and Governance
• RBAC, SSO, SCIM, and Security Administration
• Cluster Administration (Interactive, Job Clusters, SQL Warehouses, Serverless)
• Databricks Cost Management, Pricing, and FinOps Optimization
• Platform Monitoring, Auditing, and Compliance
• Multi-workspace Administration
• Hive Metastore and Hive Tables Administration
• Experience managing:
• Catalogs, Schemas, Tables, Views, and Storage Credentials
• Cluster Policies and Compute Governance
• User and Access Management
• Platform Upgrades and Runtime Management
• Workspace Provisioning and Environment Governance

AWS Platform Expertise (Mandatory)

• Hands-on experience administering Databricks on AWS.
• Strong knowledge of:
• AWS IAM
• S3 Storage
• VPC, Security Groups, and Networking
• Secrets Management
• Cloud Governance and Security Best Practices
• Experience working in enterprise-scale AWS-based Data & Analytics environments.

Technical Understanding

Although this is not a development role, the candidate must possess a good understanding of:

• Databricks Lakehouse Architecture
• Apache Spark
• Delta Lake
• Hive Metastore and Hive Tables
• Data Engineering workflows

This knowledge is required to troubleshoot platform issues, analyze job failures, perform root-cause analysis, and support engineering teams when required.

Preferred Skills

• Experience with Hive Metastore to Unity Catalog migrations.
• Strong understanding of Databricks pricing models and consumption optimization.
• Exposure to Databricks Genie AI / GenAI capabilities and their governance within Unity Catalog.
• Experience implementing enterprise security, governance, and compliance controls.
• Databricks certifications are a plus.

Ideal Candidate Profile

• Hands-on Databricks Administrator, not a Databricks Developer.
• Expert in Unity Catalog, Security, RBAC, Governance, and Cost Optimization.
• Strong experience managing clusters, SQL Warehouses, and workspace administration.
• Deep knowledge of Hive Metastore and Hive tables.
• Able to independently own and govern the Databricks platform on AWS.
• Capable of troubleshooting and debugging platform and workload issues while working closely with Data Engineering, Cloud, Security, and Infrastructure teams.

Mandatory Skills: AWS Databricks, Unity Catalog, RBAC, Security Administration, Cluster Administration, SQL Warehouses, Cost Optimization, Platform Governance, Hive Metastore/Hive Tables, Monitoring & Compliance.