Lakehouse / Data bricks Administrator

REMOTE

Any Visa type is OK

Major cities include Des Moines, Ames, Marshalltown, Newton, Fort Dodge, Iowa Falls and Grinnell.

 

Role Summary

The Lakehouse Administrator is responsible for the ongoing support, configuration, and governance of all applications operating within the Lakehouse environment. This role ensures secure, reliable, and efficient operations across Databricks and related Lakehouse platforms. The administrator will also partner closely with application teams, business stakeholders, and platform engineering to establish strong working relationships, streamline onboarding processes, and promote best practices in Lakehouse usage and architecture.

The ideal candidate will possess a strong technical foundation in cloud-based data platforms, excellent communication skills, and the ability to collaborate across diverse teams to maintain a high performing, well governed Lakehouse ecosystem.

 

Key Responsibilities

Identity & Access Management

1.    Create and maintain Entra groups and service principals

Ensure proper role assignments, lifecycle management, and alignment with security policies.

2.    Administer Lakehouse security across all applications

Manage permissions, ensure least privilege access, and maintain compliance with governance standards.

3.    Perform security audits as needed

Conduct periodic reviews, identify gaps, and coordinate remediation efforts with relevant teams.

 

Platform Configuration & Onboarding

4.    Collaborate with teams to create new Databricks catalogs and schemas

Support structured, scalable organization of data assets.

5.    Facilitate onboarding for new users and teams

Provision SQL warehouses, compute clusters, and ensure teams understand environment usage and best practices.

6.    Support setup and evaluation for proofs of value (POVs)

Provide environment configuration, oversight, and technical support for exploratory or trial initiatives.

 

Operational Monitoring & Optimization

7.    Create jobs, dashboards, and monitoring tools

Enable visibility into platform health, auditing, operational metrics, and pipeline performance.

8.    Develop methods for monitoring compute usage and costs

Track financial and operational efficiency; collaborate with teams to reduce unnecessary compute consumption.

9.    Maintain Dataflow Diagrams

Ensure accurate documentation of system flows, transformations, and dependencies.

 

Governance, Communication & Collaboration

10.   Communicate changes to downstream data consumers

Notify impacted teams when modifications occur in refined or presentation layers.

11.   Review Enterprise Architecture (EA) templates

Verify completeness and clarity before EA submission; work with vendors to correct missing or unclear items.

12.   Assist the Platform Engineer in cross team collaboration

Help establish relationships with other Databricks leveraging teams and participate in solution architecture based on business requirements.

13.   Create and maintain Lakehouse administration standards

Document best practices, standard operating procedures, and team guidelines.

 

Innovation & Continuous Improvement

14.   Stay current on Databricks releases

Track public and private preview features; evaluate relevance and communicate important updates to the team.

15.   Build strong partnerships with Lakehouse Administrators across Enterprise to learn from their approaches and share the team’s methods, ensuring alignment on best practices.