Azure Integration & Fabric Data Engineer

ESSENTIAL JOB FUNCTIONS:

• Work as an individual contributor responsible for designing, developing, and supporting enterprise-grade integration and data engineering solutions on Microsoft Azure and Microsoft Fabric.
• Design and implement robust, scalable, and secure integration and analytics solutions using Azure Integration Services and Microsoft Fabric, including:
• SQL and data modeling
• Microsoft Fabric Data Engineering
• Lakehouse architecture
• OneLake
• Apache Spark and PySpark
• Fabric Notebooks
• Fabric Data Factory
• Data Pipelines and ETL/ELT
• Data Warehousing
• Real-Time Analytics/Event Streaming
• Azure Logic Apps
• Azure Functions
• Azure API Management (APIM)
• Azure Service Bus
• Event Grid
• Event Hubs
• Azure Storage Accounts
• Azure Key Vault
• Develop API-led and event-driven integration architectures to enable seamless communication between cloud, on-premises, SaaS, third-party applications, and analytical platforms.
• Design and build scalable data ingestion, transformation, and orchestration solutions using Microsoft Fabric Data Factory, Data Pipelines, Spark Notebooks, and Lakehouses.
• Develop and manage APIs using Azure API Management (APIM), including API security, versioning, throttling, policy management, and lifecycle governance.
• Build enterprise data platforms leveraging Fabric Lakehouse, OneLake, Data Warehouse, and Delta tables for modern analytics workloads.
• Develop ETL/ELT pipelines integrating enterprise applications, databases, data lakes, ERP systems, Salesforce, and SaaS platforms.
• Design and implement real-time and event-driven data processing solutions using Event Hubs, Event Grid, Service Bus, Fabric Event Streams, and Spark Structured Streaming.
• Develop serverless integration components using Azure Functions and Azure Integration Services.
• Implement data governance, security, and compliance using Microsoft Purview, Azure AD (Entra ID), Managed Identities, OAuth 2.0, OpenID Connect, Key Vault, and role-based access control (RBAC).
• Optimize Spark workloads, Lakehouse performance, data partitioning, and ETL processing for large-scale enterprise data platforms.
• Build and maintain CI/CD pipelines using Azure DevOps and Git integration for automated deployment of Azure and Fabric solutions across multiple environments.
• Implement Infrastructure as Code (IaC) using Terraform, ARM Templates, or Bicep.
• Design monitoring, logging, alerting, and operational dashboards using Azure Monitor, Log Analytics, Application Insights, and Fabric Monitoring Hub.
• Ensure high availability, scalability, reliability, security, and performance of integration and data platforms.
• Perform production support, incident resolution, root cause analysis (RCA), performance tuning, and continuous improvement activities.
• Collaborate with enterprise architects, data architects, application teams, business analysts, and infrastructure teams to define integration and data strategies.
• Participate in architecture reviews, code reviews, governance activities, and data platform best practice initiatives.

EDUCATION & EXPERIENCE:  

MINIMUM REQUIRED QUALIFICATIONS

Experience: 7–12 years of software development and data engineering experience with strong expertise in Microsoft Azure, Azure Integration Services, Microsoft Fabric, and enterprise application integration.

SKILLS, KNOWLEDGE AND ABILITIES

Microsoft Fabric & Data Engineering

• Hands-on experience with Microsoft Fabric Data Engineering and Analytics services.
• Strong expertise in:
• Fabric Lakehouse
• OneLake
• Fabric Data Factory
• Fabric Notebooks
• Fabric Data Warehouse
• Real-Time Analytics
• Event Streams
• Semantic Models
• Strong proficiency in Spark, PySpark, SQL, and large-scale distributed data processing.
• Experience designing and implementing ETL/ELT pipelines, medallion architecture (Bronze, Silver, Gold), and Delta Lake solutions.
• Experience with data modeling, dimensional modeling, star/snowflake schemas, and analytics solution design.
• Experience integrating enterprise and SaaS applications with Fabric and Azure data platforms.
• Knowledge of data governance, security, lineage, and monitoring using Microsoft Purview and Fabric governance capabilities.

Azure Integration

• Strong hands-on experience with Azure Integration Services (AIS).
• Expertise in Azure Logic Apps, Azure API Management (APIM), Azure Functions, Service Bus, Event Grid, and Event Hubs.
• Experience migrating integrations from BizTalk Server to Azure Integration Services.
• Strong knowledge of REST, SOAP, JSON, XML, XSLT, OpenAPI/Swagger, and asynchronous messaging patterns.
• Experience implementing enterprise integration patterns and API-first architectures.

DevOps & Cloud

• Proficiency in Azure DevOps, Git, CI/CD, release management, and automated deployments.
• Experience with Terraform, Bicep, or ARM Templates.
• Experience implementing Infrastructure as Code and environment automation.
• Strong troubleshooting, analytical, and problem-solving skills.
• Experience working in Agile/Scrum environments. 

Preferred Qualifications

• Microsoft Certified: Fabric Data Engineer Associate (DP-700).
• Microsoft Certified: Azure Developer Associate (AZ-204).
• Microsoft Certified: Azure Integration and Azure Data Platform certifications.
• Experience with Power BI, semantic models, and enterprise reporting solutions.
• Experience with Databricks, Delta Lake, and modern data platform architectures.