Overview
Skills
Job Details
Key Responsibilities
Design, develop, and maintain robust data pipelines using Microsoft data technologies
Build and optimize ETL/ELT processes for structured and unstructured data
Work with Azure Data Services to ingest, process, and store large-scale data
Collaborate with data scientists, analysts, and product teams to deliver reliable datasets
Ensure data quality, integrity, security, and performance
Monitor and troubleshoot data workflows and production issues
Implement best practices for data governance and documentation
Optimize data models for analytics and reporting use cases
Required Skills & Qualifications
Proven experience as a Data Engineer
Microsoft company experience or extensive work in Microsoft enterprise environments
Strong hands-on experience with:
Azure Data Factory
Azure Synapse Analytics
Azure Data Lake (ADLS)
Azure SQL / SQL Server
Strong SQL skills and experience with performance tuning
Proficiency in Python, Scala, or C#
Experience with big data processing (Spark, Databricks)
Understanding of data warehousing concepts and dimensional modeling
Experience with CI/CD pipelines and version control (Git, Azure DevOps)
Preferred Qualifications
Experience working at Microsoft or on large-scale Microsoft enterprise projects
Familiarity with Power BI and analytics workloads
Knowledge of cloud security and compliance standards
Experience with real-time or streaming data (Event Hubs, Kafka)
Microsoft Azure certifications (e.g., Azure Data Engineer Associate)