Lead Data Engineer - Databricks[Hybrid Denver]

Overview

Hybrid
Depends on Experience
Contract - W2

Job Details

No sponsorship available. No third-party/C2C candidates.

Lead Data Engineer
Hybrid – Denver, CO | 2 Days Onsite Weekly (Client-Dependent)

This is an exclusive, off-market opportunity. Our executive client searches are confidential. Apply now to learn more about this unique new position!

What’s in it for you:

This is a high-impact leadership role with visibility across cloud, ML, and data architecture initiatives for a national enterprise client. You’ll contribute to mission-critical modernizations and be empowered to influence long-term strategy and technical execution.

What you get to do:

  • Architect, build, and scale modern data pipelines and machine learning workflows using Databricks, Delta Lake, and MLflow.

  • Lead complex Spark job migrations from platforms like EMR to Databricks, optimizing for scalability, cost-efficiency, and maintainability.

  • Collaborate cross-functionally with cloud engineers, DevOps teams, and business stakeholders to align technical solutions with evolving enterprise needs.

  • Serve as a technical consultant and thought partner to client leadership on best practices in MLOps, data transformation, and model deployment.

  • Lead and mentor a team of data engineers, fostering a culture of innovation and excellence in delivery.

  • Implement data governance frameworks, including Unity Catalog, to ensure secure and compliant data usage.

  • Champion modern DevOps/CI-CD practices to support reliable, automated data workflows and ML model lifecycle management.

What you need to succeed:

  • 7+ years of data engineering experience, including at least 2 years in a leadership or consulting capacity.

  • Deep hands-on expertise in Databricks, including Delta Lake, MLflow, Job Workflows, and Unity Catalog.

  • Proven success migrating and optimizing Spark workloads from EMR or other platforms to Databricks.

  • Strong grasp of MLOps, with experience building and deploying ML models in production.

  • Solid cloud engineering background in AWS, Azure, or GCP.

  • Proficiency in Python, SQL, and Spark.

  • Familiarity with streaming technologies (e.g., Kafka, Delta Live Tables) and medallion data architecture.

  • Excellent stakeholder engagement and client-facing communication skills.

  • Consulting mindset with the ability to lead complex initiatives in dynamic, fast-paced environments.

Bonus Perks:

As a valuable new member of the team, you will have access to our company’s extensive client list, the support of a tenured team, and the opportunity to enroll in a variety of health benefit plans. We are eager to help ensure your success in this exciting new role.

Want to find out more about this job opportunity? Apply now!
#IND1

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.