Overview
Skills
Job Details
Job Title: Lead Data Engineer Azure
Location: Remote (EST hours)
Type: Contract / FTE
Seeking a Lead Data Engineer with deep expertise in Azure Data Services, DBT, Snowflake, and Snowflake Cortex. You will design and optimize scalable pipelines, ensure data quality/governance, and enable AI-driven analytics with Cortex & GenAI.
Key Responsibilities-
Build & optimize pipelines using Azure Data Factory, DBT, Databricks
-
Develop modular DBT models for transformations & analytics
-
Design Snowflake architectures and integrate Cortex functions (forecasting, anomaly detection, sentiment analysis, summarization, embeddings, etc.)
-
Implement data quality & governance frameworks (Snowpark UDFs, anomaly detection)
-
Collaborate with analytics teams to deliver clean, trusted datasets
-
7 10+ years in data engineering
-
Strong experience with Azure Data Factory, DBT, Databricks
-
Deep expertise in Snowflake, Snowpark APIs, Cortex ML/LLM functions
-
Proficiency in Python & SQL
-
Familiarity with GenAI & open-source LLMs
-
Strong data modeling, transformation & pipeline optimization skills
-
Excellent collaboration & stakeholder engagement