Lead/Principal Microsoft Fabric Data Engineer

Job Title: Lead/Principal Microsoft Fabric Data Engineer

Location: Dallas TX (Can be remote)

ROLE SUMMARY

Design and build the migration of enterprise Tableau dashboards from on-prem SQL Server (Epic Clarity ~90%) onto a governed Fabric medallion architecture. Greenfield Fabric build: define Bronze/Silver/Gold standards, workspace/capacity topology, and Lakehouse-vs-Warehouse decisions; engineer the pipelines, notebooks, and Gold/semantic data products that Tableau published data sources connect to.

KEY RESPONSIBILITIES

• Stand up the Fabric medallion using hybrid model: Bronze and Silver in the Lakehouse (Delta), Gold in the Fabric Warehouse (T-SQL).
• Build Bronze and Silver in the Lakehouse using Spark/PySpark notebooks and Data Factory pipelines (source-aligned Bronze; deduplicated, standardized, reusable Silver).
• Build the Gold layer in the Fabric Warehouse as enterprise dimensional models (facts, dimensions, aggregations, KPIs) using T-SQL, loading from Silver via Data Factory pipelines, Spark notebooks, or Dataflow Gen2.
• Translate parsed Tableau embedded/custom SQL into reusable Silver logic and business-ready Gold fact/dimension products.
• Build Gold dimensional models and Fabric semantic models / Direct Lake datasets that replace embedded SQL as published Tableau data sources.
• Act as the human-in-the-loop reviewer on the automated Bronze/Silver/Gold recommendations: judge whether a subquery is a reusable business concept, whether a Fabric object already implements it, and fact vs dimension vs report-specific mart.
• Implement governance/security: Purview cataloging & lineage, sensitivity labels, RLS/OLS, PHI/HIPAA controls.
• Establish and enforce naming/medallion/governance standards across waves.
• Implement CI/CD via Azure DevOps and Fabric git integration / deployment pipelines.
• Lead data reconciliation and validation against source systems, partnering with business owners on automated comparisons and joint sign-off checkpoints.
• Collaborate with Tableau team to repoint connections to Fabric-backed data sources.

REQUIRED QUALIFICATIONS

• 12+ yrs data engineering/data warehousing, incl. lead-level platform architecture ownership.
• 3+ yrs hands-on Microsoft Fabric (Lakehouse, Warehouse, Data Factory, Spark notebooks, Dataflows Gen2, Direct Lake, semantic models) or equivalent Synapse/ADF with recent Fabric delivery.
• Expert T-SQL with proven Fabric Warehouse (or SQL DW / dedicated SQL pool) delivery of enterprise dimensional Gold models.
• Strong Spark/PySpark for Lakehouse Bronze/Silver transformations, and proven medallion / lakehouse architecture implementation at scale.
• Strong dimensional modeling (Kimball) for Warehouse-based Gold fact and dimension design.
• Hands-on data governance: Microsoft Purview, lineage, sensitivity labels, and row-level / object-level security.
• CI/CD for data platforms with Azure DevOps and git-based deployment.
• Track record migrating or consolidating large BI/data estates onto a modern cloud data platform.
• Agentic AI / MCP-driven automation.

TECH STACK

• Microsoft Fabric (Lakehouse, Warehouse, Data Factory, Notebooks/Spark, Dataflows Gen2, Direct Lake, Semantic Models) ·

• OneLake
• T-SQL
• PySpark
• Python
• SQLGlot
• Microsoft Purview
• Azure DevOps
• Power BI / Tableau
• SQL Server / Epic Clarity

PREFERRED QUALIFICATIONS

• Microsoft Certified: Fabric Data Engineer Associate / Fabric Analytics Engineer Associate; Azure Data Engineer Associate.
• Epic Clarity / Caboodle experience.
• Experience integrating Fabric Warehouse (SQL endpoint, XMLA, Direct Lake) as a published data source for Tableau consumption.
• Familiarity with SQL parsing/normalization (SQLGlot/Python) and duplicate-logic detection to accelerate first-pass medallion classification.