A public-sector organization is seeking an Intermediate Enterprise Data Platform Engineer to support enterprise analytics and AI/ML workloads by enabling standardized, governed, and trusted data across the organization. The Databricks Platform Administrator will serve as the technical owner responsible for end-to-end platform operations, security, governance, and performance optimization.
This role ensures the enterprise data platform remains compliant, reliable, cost-optimized, and scalable for complex data workloads.
Administer Databricks accounts and workspaces across SDLC environments, ensuring standardization and operational consistency
Configure and maintain compute resources including clusters, jobs, SQL warehouses, runtimes, repositories, and libraries
Implement monitoring, alerting dashboards, and operational runbooks to ensure reliable platform operations
Provide Tier 2/3 incident response, root cause analysis, and preventive remediation
Manage platform upgrades, feature rollouts, configuration changes, and change control processes
Enforce least-privilege access using IAM, SCIM, RBAC, and group-based controls
Govern secrets, credential management, audit logging, and compliance evidence collection
Administer Unity Catalog including metastores, schemas, grants, ownership, and external storage configurations
Integrate Databricks with AWS services including IAM, object storage, networking, monitoring, and PrivateLink
Drive cost optimization through cluster policies, auto-termination, scheduling, and usage insights
Automate configuration and environment promotion using Terraform, CLI, APIs, and CI/CD pipelines
Partner with Security, Networking, and Governance teams on data lineage, classification, retention, and secure connectivity