Tech Lead - Data Engineer

Overview

Remote
Depends on Experience
Contract - Independent
Contract - 6 Month(s)
No Travel Required

Skills

Lead
Data Engineer
Amazon Web Services
AWS
Databricks
Azure
Data Architecture
Python
SQL
Medallion architecture
Google Cloud

Job Details

Our client is unable to hire H1-B candidates at this time.

Client is a small, growing consulting company, with a focus on AI and Data Solutions. They are seeking a Tech Lead - Data Engineer

As the Tech Lead:

You will serve as the technical lead on client engagements. This is a hands-on role, where you lead a team of 2-5 engineers, own the overall solution design, work breakdown, architecture and implementation of data pipelines, lakes, and infrastructure. You will collaborate closely with our clients and cross-functional teams guiding technical decision-making, coordinating work and ensuring our data platforms are scalable, secure, and future-ready. This role is ideal for someone who enjoys solving complex data challenges, leading a small team of engineers and data scientists, and thrives in a high-ownership, hands-on environment.

Key Responsibilities:

  • Lead project engineering teams, derive the architecture, and develop data lakes and scalable data pipelines using Databricks and Azure (Amazon AWS and Google Cloud are also possibilities).
  • Design and implement medallion architecture (Bronze, Silver, Gold layers) to support analytics, reporting, and machine learning use cases.
  • Collaborate with product managers, designers, and client stakeholders to translate business requirements into effective data solutions.
  • Build and optimize data models and pipelines for performance, maintainability, and security.
  • Apply DevOps and engineering best practices including CI/CD, testing, monitoring, and automation in data workflows.
  • Ensure best practices in data governance, privacy, and access control are applied across all systems.
  • Support delivery across complex programs, helping align technical strategy with project milestones.
  • Serve as a go-to expert for data engineering standards and problem-solving within the team.

Qualifications:

  • 7+ years of direct technical leadership experience in data engineering and related software development initiatives.
  • Deep expertise with Azure and Databricks (or similar data platforms), including Delta Lake and Unity Catalog.
  • Proficiency in Python and SQL, with hands-on experience building robust, production-grade data pipelines.
  • Strong understanding of data architecture patterns, including medallion architecture and business intelligence.
  • Experience with Azure services such as Data Lake Storage Gen2, Data Factory, and Key Vault.
  • Familiarity with tools like MLflow and a willingness to quickly learn new platform capabilities.
  • Ability to communicate clearly with technical and non-technical stakeholders.
  • A high degree of independence, accountability, and problem-solving ability.
  • Experience in a professional consulting role and/or the healthcare industry a plus
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Will-N-Able