Data Platform Technical Lead

Overview

Remote
Up to $120,000
Full Time

Skills

Data Platform
lead
data factory
azure
Snowflake
kafka

Job Details

Job Title: Data Platform Technical Lead

We are seeking an experienced Data Platform Technical Lead to drive the design, enablement, and modernization of enterprise-scale data platforms. This role will be instrumental in ensuring data is fully operationalized in Snowflake and Data Compass, while also leading the transformation of the Data Factory, refining technical requirements for new capabilities, and collaborating on POCs and UI development with customers and partners.

Key Responsibilities:

  1. Platform Enablement:
  • Ensure seamless data integration, access, and availability in Snowflake and Data Compass.
  • Oversee data governance, lineage, and cataloging within Data Compass and similar tools.
    1. Data Factory Modernization:
  • Lead modernization of Azure Data Factory pipelines and architectures.
  • Normalize and optimize data pipelines to improve scalability and performance.
    1. Requirements Refinement:
  • Collaborate with business and analytics teams to define and refine capability requirements.
  • Translate business needs into scalable technical architecture and data solutions.
    1. End User Interface Development:
  • Guide UI developers to build intuitive, data-driven interfaces for internal stakeholders.
  • Ensure interfaces meet performance, usability, and data visualization standards.
    1. Customer and Partner Collaboration:
  • Work directly with external partners and customers on Proof of Concepts (POCs).
  • Co-create innovative data-driven solutions and accelerators for client success.
    1. Data Quality & Standards:
  • Define standards for data quality, modeling, and transformation.
  • Establish best practices and frameworks for reusable data pipelines.

Required Skills and Qualifications:

  • 8 12 years of hands-on experience in Data Engineering, with recent experience in Snowflake and Azure Data Factory.
  • Strong programming in SQL or Python
  • Experience with metadata management and governance tools (e.g., Data Compass, Alation, Azure Purview).
  • UI/data interface development exposure (React, Power BI, Tableau).
  • Strong collaboration and communication skills to work with cross-functional and external teams.
  • Experience with agile delivery and leading POCs or innovation pods.

Nice to Have:

  • Experience with dbt, Databricks, Kafka, and Terraform/IaC.
  • Prior work in financial services or regulated data environments.
  • Familiarity with customer co-creation, data monetization, or platform productization.

Tools & Tech Stack:

Domain

Tools

Data Platform

Snowflake, Azure Synapse, Databricks

ETL / Pipelines

Azure Data Factory, dbt, Python, PySpark

Metadata / Governance

Data Compass, Alation, Purview

UI Development

Power BI, React, Streamlit

Orchestration

Airflow, Azure Data Factory

DevOps

GitHub Actions, Terraform, Docker

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.