Azure Data Engineer – W2 Requirement

Job Title: Azure Data Engineer – W2 Requirement

Location: Minneapolis,MN
Experience: 8+ Years
Work Mode: Hybrid Onsite 3days a week
Duration: Contract W2

Job Description

We are looking for an experienced Azure Data Engineer with strong expertise in Microsoft Azure data services, data pipeline development, ETL/ELT processes, and cloud-based data engineering solutions. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data platforms.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build data processing solutions using Azure Data Factory (ADF) and Azure Databricks.
• Develop complex SQL queries, stored procedures, and data transformation logic.
• Work with Azure Data Lake Storage Gen2 and Azure Synapse Analytics.
• Develop data transformation workflows using PySpark and Python.
• Implement data integration, data quality, and data validation processes.
• Optimize pipeline performance, troubleshoot failures, and improve data processing efficiency.
• Collaborate with data analysts, architects, and business teams.
• Implement security, monitoring, and governance best practices.

Required Skills

• Strong experience with Microsoft Azure data engineering services.
• Hands-on experience with Azure Data Factory (ADF).
• Strong SQL and database concepts.
• Experience with Azure Databricks and PySpark.
• Knowledge of Python programming and ETL/ELT development.
• Experience with Azure Data Lake Storage Gen2.
• Familiarity with Azure Synapse Analytics.
• Experience with Git, CI/CD pipelines, and data pipeline deployment.
• Understanding of data warehousing, dimensional modeling, and data lake architecture.

Preferred Skills

• Experience with Azure Event Hubs or streaming data.
• Knowledge of Delta