Databricks Platform Engineer

Blu Omega is seeking a Databricks Platform Engineer to support a Federal client onsite in Atlanta, GA or DC Metro. This role is focused on Azure Databricks platform ownership account/workspace administration, governance, security, auditability, private networking enablement, and cost controls across multiple environments (e.g., Dev/QA/Prod). This is not primarily a Databricks data engineering / Spark development role.

Location: Must be located either Washington, DC or Atlanta, GA Metro area.

Responsibilities

• Own Databricks Account Console and multi-workspace administration, including workspace provisioning, entitlements, configuration, and environment separation (Dev/QA/Prod).
• Implement and operate enterprise identity and access capabilities, including SSO and SCIM provisioning (e.g., Microsoft Entra ID/Azure AD, Okta) and RBAC at scale.
• Architect and administer Unity Catalog governance, including catalog/schema/table permissions, privilege models, service principals, and cross-workspace access patterns.
• Design, implement, and enforce cluster policies and platform guardrails (tagging standards, runtime controls, instance restrictions, library controls, quotas/limits) for security and cost governance.
• Configure and maintain secrets management (secret scopes) and secure integrations with Azure Key Vault.
• Configure and operate audit logging and monitoring to support compliance, investigations, and incident response involving sensitive data (PII/PHI).
• Partner with cloud/network teams (and own Databricks-side configuration) to enable private networking patterns supporting Databricks (e.g., VNet injection, private endpoints/Private Link, peering, restricted egress/ingress).
• Deliver cost governance and reporting, including tagging/chargeback approaches and dashboards for spend attribution and trend analysis.
• Build automation to streamline administration and policy enforcement using Terraform and/or Databricks APIs.
• Maintain platform standards, runbooks, and configuration baselines; manage feature enablement by environment (e.g., enable in Dev but restricted in Prod).
• Provide technical leadership and mentoring; contribute to a collaborative team environment and strong operational practices.

Requirements

• 5+ years of hands-on Databricks platform administration (not just Databricks usage), including Account Console and Workspace Administration in enterprise environments.
• Proven experience implementing and operating:
  • SSO + SCIM provisioning with an enterprise IdP (e.g., Entra ID/Azure AD, Okta)
  • Unity Catalog governance and permissions/RBAC design across multiple workspaces
  • Cluster policy design and enforcement (security + cost guardrails)
  • Audit logging configuration and operational use for compliance/investigations
  • Secrets management (secret scopes; Key Vault integration preferred)
• Azure experience supporting regulated platforms, including Entra ID and core security practices; ability to collaborate with networking teams on private connectivity patterns.
• Experience driving cost optimization and platform reliability (guardrails, monitoring, operational response).
• Strong documentation and communication skills (runbooks, standards, stakeholder-facing explanations).
• Ability to obtain and maintain a Public Trust / Suitability determination.
• Master s degree.
• Must be local to Atlanta GA or the DC Metro area

Preferred

• Experience supporting Azure Databricks private connectivity implementations (e.g., VNet injection, private endpoints/Private Link).
• Databricks Platform Administrator certification.
• Microsoft Certified: Azure Administrator Associate.
• Strong Terraform/IaC implementation experience for Databricks workspace provisioning and policy enforcement.
• Experience with FinOps/chargeback reporting and governance for shared compute platforms.