Data Engineering Manager

Overview

Remote
$150,000 - $175,000
Full Time

Skills

Amazon Web Services
Apache Spark
Cloud Computing
Analytics
Continuous Delivery
Continuous Integration
Data Engineering
Data Governance
Data Modeling
Data Processing
Data Quality
Data Warehouse
Databricks
ELT
Extract
Transform
Load
Leadership
Mentorship
Microsoft Azure
Python
Relational Databases
SQL

Job Details

Title: Data Engineering Manager
Location: Saint Paul, MN (55102) / Remote
Employment Type: Full-Time Direct Hire (No C2C or sponsorship available)

Job Description:
Talent Groups is seeking an experienced Data Engineering Manager with strong, hands-on expertise in Databricks to lead a high-performing data engineering team. In this role, you will be responsible for architecting, developing, and managing modern data solutions, overseeing complex data pipelines, and implementing best practices for scalability, performance, and governance. The ideal candidate will combine deep technical expertise with proven leadership skills, fostering collaboration between engineers, analysts, and business stakeholders.

Key Responsibilities

  • Lead, mentor, and manage a team of data engineers, fostering a culture of technical excellence, innovation, and accountability.
  • Architect, build, and maintain large-scale data processing solutions in Databricks, leveraging Spark, Delta Lake, and related technologies.
  • Oversee the design and implementation of ETL/ELT pipelines to integrate diverse data sources into enterprise data platforms.
  • Ensure data quality, governance, and security standards are upheld across the organization.
  • Collaborate with product managers, data scientists, and business teams to translate requirements into scalable, efficient data solutions.
  • Optimize data workflows for performance and cost efficiency in cloud environments (Azure, AWS, or Google Cloud Platform).
  • Manage project timelines, resource allocation, and stakeholder communication to deliver on strategic data initiatives.
  • Stay informed on emerging trends and advancements in data engineering, cloud computing, and analytics technologies.

Required Skills & Experience

  • 8+ years of professional data engineering experience, including at least 3 years in a leadership or management role.
  • Proven, hands-on expertise in Databricks and Spark-based data processing.
  • Strong experience in data modeling, relational and non-relational databases, and data warehousing concepts.
  • Proficiency in SQL, Python, and/or Scala for data engineering tasks.
  • Demonstrated success in building and maintaining ETL/ELT pipelines at enterprise scale.
  • Cloud platform experience (Azure preferred; AWS or Google Cloud Platform also considered).
  • Excellent leadership, communication, and stakeholder management skills.
  • Bachelor s or Master s degree in Computer Science, Data Engineering, or a related field.

Preferred Qualifications

  • Experience with Delta Lake, MLflow, or other tools in the Databricks ecosystem.
  • Background in implementing CI/CD for data pipelines and infrastructure as code.
  • Familiarity with modern data governance frameworks and compliance standards.

Talent Groups appreciates all applicants; however, only those selected for an interview will be contacted.
Talent Groups is an equal opportunity employer.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.