Overview
On Site
Depends on Experience
Contract - Independent
Contract - W2
Skills
ADF
Data Lake
Databricks
Microsoft SQL Server
Migration
PL/SQL
PySpark
Query Optimization
Snow Flake Schema
Data Engineering
Job Details
Senior Lead ADF Engineer
Location: Texas, United States
Job Summary:
We are seeking a skilled and experienced Azure Data Engineer with a strong background in ETL, Azure Data Factory (ADF), Azure Synapse, and SQL Server. The ideal candidate will have hands-on expertise in data integration, migration, and transformation using Microsoft Azure services, with strong experience in Azure Functions, Logic Apps, and advanced SQL/PLSQL development.
Key Responsibilities:
Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse.
Migrate data solutions to Azure using Azure Data Lake, Data Lake Gen2, Azure SQL Pools, and Databricks.
Develop ADF pipelines, copy activities, and custom Azure components to ingest and transform data.
Write and optimize complex T-SQL and Synapse SQL queries for analytics and reporting.
Develop and implement PolyBase scripts to load data from Azure Data Lake to staging areas in Synapse Analytics.
Perform query tuning, monitoring, and database performance optimization.
Utilize Azure Functions and Logic Apps to orchestrate data workflows and custom automation logic.
Implement data modeling concepts including Star Schema and Snowflake Schema for efficient data warehousing.
Participate in metadata and data mart design and extension.
Collaborate with cross-functional teams to meet business data needs and ensure data quality and reliability.
Provide technical guidance and best practices related to Azure data engineering.
Required Qualifications:
8+ years of overall experience in data engineering and analytics.
4+ years of experience in ETL development and data integration.
4+ years of experience with Azure Data Factory (ADF).
4+ years of experience with Microsoft SQL Server and T-SQL.
2+ years of experience with Azure Functions and Logic Apps.
Hands-on experience with Azure Databricks, Data Lake (ADLS Gen2), Azure Blob Storage.
Proficiency in PL/SQL, triggers, views, indexes, and schema design.
Experience in implementing at least 2 projects in Azure Synapse and SQL Server analytics.
Strong knowledge of PolyBase, metadata management, and data model design.
Excellent written and verbal communication skills.
Preferred Qualifications:
Experience with PySpark.
Microsoft Azure certifications (e.g., DP-203: Data Engineering on Microsoft Azure).
Familiarity with Azure Storage Explorer and DevOps practices.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.