Senior Fabric ETL Developer

Title: Senior Fabric ETL Developer
Location: Remote
Contract

SUMMARY: Our client would like us to provide them with a Senior Developer with extensive experience in Microsoft Fabric, specializing in Lakehouse-based data processing and Fabric Notebooks utilizing PySpark. This role focuses on transforming curated Lakehouse data into standardized and custom text file extracts (e.g., CSV, TXT, pipe-delimited) for secure delivery to external vendors and partners.

Additionally, the Developer will partner with the business and all data trading partners to support daily data processing and implementations. 
Successful individuals will be able to effectively operate in a fast-paced environment utilizing their excellent time management, communication, collaboration, and critical thinking skills in combination with their deep technical expertise to drive the success of their tasks from beginning to end.

DUTIES AND RESPONSIBILITIES:  

• Architect, design, and lead the development of Fabric Notebooks utilizing PySpark to transform Lakehouse data into vendor-ready extracts.
• Establish and enforce engineering standards and best practices for notebooks and data pipelines.
• Support day-to-day operations with hands-on approach and passion for delivering best-in-class services to internal and external stakeholders.
• Lead development of production-grade notebooks ensuring performance, scalability, and reliability.
• Mentor and provide technical guidance to junior and mid-level developers.
• Implement data validation, formatting rules, and reconciliation checks prior to extract delivery.
• Work with internal and external stakeholders to gather, analyze, and document requirements.
• Build new export processes and modify/support existing export processes based on business, client, and vendor requirements. 
• Analyze the data exchanged with stakeholders to troubleshoot, record, and address errors and implement corrections.
• Work on creating and maintaining feature-rich scheduling, tracking, and error handling solutions.
• Identify risk and failure points with a constant focus on process improvement and automation.
• Other duties as assigned.

REQUIRED EXPERIENCE AND EDUCATION:

• Bachelor''s degree diploma in computer science or software engineering or equivalent experience.
• Extensive experience with Microsoft Fabric in production environments.
• Advanced expertise in notebook-based development and PySpark.
• Strong background in Azure DevOps, including pipeline automation and release management.
• Expert-level Git usage, including complex branching and multi-repo strategies.

SKILLS AND ABILITIES:

• Ability to read, interpret, and map file specifications and export files according to the specifications.
• Understanding of IT principles and business processes with an ability to communicate technical concepts effectively to a varied audience.
• Demonstrated ability to understand complex business needs.
• Demonstrated attention to detail in designing, reviewing, and deploying production-grade solutions.
• Proven ability to analyze complex problems and deliver effective solutions.
• Ability to find creative solutions to technology challenges.
• Strong ability to effectively communicate both verbally and in writing.
• Ability to work with remote teams including working closely with business professionals as well as technical resources and vendors.
• Possess excellent organizational, time management, and follow-up skills.
• Demonstrates ability to work independently, take initiative, and be self-motivated.
• Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
• Ability to make effective decisions under pressure and work in fast-paced environment.
• Demonstrated ability to treat confidential information with discretion.
• Knowledge of healthcare industry.