Microsoft Fabric Data Engineer

Job Title: Microsoft Fabric Data Engineer

Location: Remote.

Years of Experience Required: 5–10 years overall, with 3–5 years in data engineering and 2+ years hands-on with Azure/Microsoft Fabric

Visa Status: [ / GC]

Domain/Industry: IT / Data Engineering / Analytics (Healthcare)

Top 3–4 Required Skills

1. Microsoft Fabric expertise – Data Factory, Lakehouse, OneLake, Spark, Fabric Warehouse
2. Advanced SQL & PySpark – complex queries, transformations, performance tuning
3. Data migration & modernization – Azure SQL → Fabric, ETL to ELT redesign
4. Lakehouse/Medallion architecture implementation – Bronze, Silver, Gold layers

Job Description (JD)

We are seeking a highly skilled Microsoft Fabric Data Engineer to lead the modernization of our enterprise data platform. The candidate will play a pivotal role in migrating existing Azure SQL and ETL-based systems into Microsoft Fabric, leveraging Fabric’s advanced capabilities to build scalable, secure, and analytics-ready solutions.

Key Responsibilities:

• Data Migration & Engineering:
• Migrate data from Azure SQL databases and legacy ETL pipelines into Microsoft Fabric.
• Redesign ETL processes into ELT-based architectures using Fabric’s native features.
• Implement Medallion architecture (Bronze, Silver, Gold) for structured data layering.
• Design efficient ingestion, transformation, and orchestration pipelines.
• Fabric Data Development:
• Build and manage pipelines using Fabric Data Factory.
• Develop transformations using Spark notebooks (PySpark/SQL).
• Create and manage Fabric Warehouses and optimized data models.
• Work with OneLake for unified storage and seamless data access.
• Performance & Optimization:
• Optimize Spark jobs, pipelines, and warehouse queries for speed and scalability.
• Implement partitioning, incremental loads, and CDC patterns.
• Ensure data quality, consistency, and reliability across environments.
• Security & Governance:
• Collaborate with Fabric administrators on RBAC, workspace design, and access controls.
• Apply governance standards including naming conventions, lineage, and metadata.
• Support integration with Microsoft Purview for enterprise data governance.
• DevOps & Automation:
• Implement CI/CD pipelines for Fabric artifacts using Git/Azure DevOps.
• Automate deployments and validation checks.
• Manage environment promotion (Dev → Test → Prod).
• Collaboration & Support:
• Partner with BI teams to enable Power BI semantic models and reporting.
• Work closely with stakeholders to capture requirements and meet SLAs.
• Provide production support, troubleshooting, and performance monitoring.

Required Skills & Qualifications

• Strong experience in data engineering with Microsoft Azure.
• Hands-on expertise with Microsoft Fabric (Data Factory, Lakehouse, OneLake, Spark, Fabric Warehouse).
• Proficiency in SQL and PySpark for transformations and analytics.
• Deep knowledge of modern data architectures (Lakehouse, ELT, Medallion).
• Proven track record in data migration and modernization projects.

Preferred / Nice-to-Have Skills

• Power BI (data modeling, performance tuning).
• Microsoft Purview or other governance tools.
• Experience with CDC, event-driven ingestion, or streaming data pipelines.
• Relevant Fabric or Azure Data Engineer certifications.

Soft Skills

• Strong analytical and problem-solving mindset.
• Ability to thrive in agile delivery models.
• Clear communication with both technical and non-technical stakeholders.
• Ownership mindset for data reliability, quality, and scalability.

Key Deliverables

• Successful migration of data platform from Azure SQL + ETL → Microsoft Fabric.
• Scalable and performant Fabric data pipelines supporting enterprise workloads.
• Analytics-ready datasets enabling enterprise reporting and actionable insights.