Overview
Skills
Job Details
Job Description
We are looking for an Azure Data Engineer with hands-on expertise in Microsoft Fabric, cloud-native data architectures, and AI integration. The ideal candidate will architect and deliver end-to-end data engineering and AI solutions using Microsoft Fabric, Azure OpenAI, and related ecosystem components while driving business value through advanced analytics and responsible AI practices.
Must Have Technical/Functional Skills
10+ years of experience in data engineering within cloud-native architectures (Azure).
Hands-on expertise with Microsoft Fabric components: Data Factory, OneLake, Lakehouse, Power BI, and KQL.
Strong programming and modeling skills in SQL, Python, DAX, and Spark/Python development.
Experience with Azure OpenAI Service, Copilot, and LLM integration.
Familiarity with containerization (Docker), Azure Container Apps, and Azure DevOps tools.
Strong communication and documentation skills.
Preferred Certifications
Microsoft Certified: Azure Data Engineer Associate
Microsoft Certified: Azure AI Engineer Associate
Microsoft Certified: Fabric Analytics Engineer Associate
Microsoft 365 Certified: Enterprise Administrator Expert
Primary Responsibilities
Architect end-to-end Microsoft Fabric solutions, including Data Factory, OneLake, Lakehouse, and real-time analytics platforms.
Design and deploy AI models using Azure AI Foundry and Azure OpenAI Service.
Implement Copilot solutions across the Microsoft ecosystem with integration to Fabric data sources.
Build and optimize data pipelines from multiple sources (SQL, APIs, Salesforce, Oracle, Dynamics).
Design and maintain semantic models and implement Medallion architecture (bronze, silver, gold).
Develop real-time streaming analytics using Event Streams and KQL databases.
Monitor and optimize workloads using Fabric Capacity Metrics, addressing ingestion and modeling issues.
Bonus: Build and deliver solutions on Databricks platform (preferred).
AI & Advanced Analytics Focus
Customize and implement Microsoft Copilot solutions (e.g., Copilot for Power Platform, Fabric).
Work with GPT models and apply prompt engineering through Azure OpenAI Service.
Build RAG (retrieval-augmented generation) pipelines and design hybrid search architectures.
Ensure compliance with responsible AI practices and governance frameworks.
Governance & DevOps (Preferred)
Establish data governance frameworks with Microsoft Purview and Fabric governance tools.
Implement CI/CD pipelines and best practices in DevOps for data and AI platforms.
Manage RBAC and zero-trust security across Azure/Fabric workspaces. Generic Managerial Skills, If any:
- Lead a Team of 3-5 developers.
- Follow Scrum practices to lead team and manage deliveries.