Role Summary
The Databricks/Lakehouse Administrator is responsible for the ongoing support, configuration, and governance of all applications operating within the Lakehouse environment. This role ensures secure, reliable, and efficient operations across Databricks and related Lakehouse platforms. The administrator will also partner closely with application teams, business stakeholders, and platform engineering to establish strong working relationships, streamline onboarding processes, and promote best practices in Lakehouse usage and architecture.
The ideal candidate will possess a strong technical foundation in cloud-based data platforms, excellent communication skills, and the ability to collaborate across diverse teams to maintain a high performing, well governed Lakehouse ecosystem.
Key Responsibilities
Identity & Access Management
1. Create and maintain Entra groups and service principals
Ensure proper role assignments, lifecycle management, and alignment with security policies.
2. Administer Lakehouse security across all applications
Manage permissions, ensure least privilege access, and maintain compliance with governance standards.
3. Perform security audits as needed
Conduct periodic reviews, identify gaps, and coordinate remediation efforts with relevant teams.
Platform Configuration & Onboarding
4. Collaborate with teams to create new Databricks catalogs and schemas
Support structured, scalable organization of data assets.
5. Facilitate onboarding for new users and teams
Provision SQL warehouses, compute clusters, and ensure teams understand environment usage and best practices.
6. Support setup and evaluation for proofs of value (POVs)
Provide environment configuration, oversight, and technical support for exploratory or trial initiatives.
Operational Monitoring & Optimization
7. Create jobs, dashboards, and monitoring tools
Enable visibility into platform health, auditing, operational metrics, and pipeline performance.
8. Develop methods for monitoring compute usage and costs
Track financial and operational efficiency; collaborate with teams to reduce unnecessary compute consumption.
9. Maintain Dataflow Diagrams
Ensure accurate documentation of system flows, transformations, and dependencies.
Governance, Communication & Collaboration
10. Communicate changes to downstream data consumers
Notify impacted teams when modifications occur in refined or presentation layers.
11. Review Enterprise Architecture (EA) templates
Verify completeness and clarity before EA submission; work with vendors to correct missing or unclear items.
12. Assist the Platform Engineer in cross team collaboration
Help establish relationships with other Databricks leveraging teams and participate in solution architecture based on business requirements.
13. Create and maintain Lakehouse administration standards
Document best practices, standard operating procedures, and team guidelines.
Innovation & Continuous Improvement
14. Stay current on Databricks releases
Track public and private preview features; evaluate relevance and communicate important updates to the team.
15. Build strong partnerships with Lakehouse Administrators across Enterprise to learn from their approaches and share the team s methods, ensuring alignment on best practices.
Never miss an opportunity! Create an alert based on the job you applied for.
