Azure Data Engineer/Architect

Job Summary:
Our client is seeking a Data Integration Specialist with experience in Azure, SQL, Microsoft Fabric, and data warehousing to support their growing team of developers. The ideal candidate will play a pivotal role in transitioning the acquired company’s systems to their platform, assisting with critical go-live phases and future initiatives. This position is integral to meeting project deadlines and ensuring a seamless migration from legacy integration tools to Microsoft Azure and Fabric-based platforms.
Responsibilities:

• Design and Develop Integration Solutions
  • Create and implement integration workflows by understanding business requirements, data sources, and target systems.
  • Architect solutions that integrate Microsoft Fabric pipelines, Lakehouses, and OneLake storage with enterprise systems.
• Build Data Integration Processes
  • Develop and configure ETL processes using Azure Data Factory (ADF) and Microsoft Fabric Data Pipelines to move and transform data between ERP systems, Medius, Workday, and other applications.
  • Use Dataflows Gen2 in Fabric for data ingestion and transformation.
• Maintain Data Warehouse and Lakehouse Systems
  • Manage integration from ERP systems and other data sources into both traditional data warehouses and Fabric Lakehouses, ensuring timely and accurate data availability for analytics.
  • Ensure seamless flow of data into Power BI reports through integration with Microsoft Fabric datasets.
• Implement EDI File Transmission
  • Configure integration systems to handle the transmission and transformation of EDI messages between trading partners, ensuring compliance with industry standards.
  • Integrate with Workday and Medius
  • Establish seamless data movement from Workday and Medius into Microsoft Fabric and Azure environments for effective AP automation and invoice processing.
• Collaborate with Stakeholders
  • Work closely with business analysts, data architects, and system administrators to gather requirements and deliver scalable integration solutions.
• Ensure Data Quality
  • Implement validation mechanisms across the data pipeline using Data Quality rules in Fabric to ensure data accuracy, consistency, and conformance with business rules.
• Optimize Performance
  • Analyze performance of Fabric data pipelines and optimize for speed, cost-efficiency, and reliability.
  • Utilize Performance Analyzer tools in Power BI and Fabric Monitoring Hub for ongoing improvement.
• Document and Report
  • Maintain detailed technical documentation of integration processes, mappings, configurations, and workflows.
  • Generate metadata and operational reports through Fabric Monitoring and Metrics dashboards.
• Continuous Improvement
  • Stay current with the latest technologies in Microsoft Azure, Microsoft Fabric, Workday, Medius, and enterprise integration trends.

Qualifications:

• Experience using Azure Data Factory, Azure SQL DB, Synapse, and Microsoft Fabric (Lakehouses, Pipelines, Dataflows Gen2, OneLake).
• Heavy SQL experience including SSMS, SSIS, SSAS.
• Strong understanding of integration technologies including REST/SOAP APIs, JSON, XML, and flat files.
• Experience integrating with ERP and cloud-based applications (e.g., Workday, Medius).
• Familiarity with event-driven architectures, Pub/Sub models, and data streaming platforms.
• Working knowledge of relational databases like SQL Server, Oracle, or MySQL.
• Excellent technical documentation, design, and collaboration skills.