Overview
On Site
Contract - W2
Contract - 12
Skills
Microsoft Purview
Microsoft Fabric with Azure
Job Details
EST Time zone candidates only
Below is the JD -
Microsoft Fabric POC Implementation
- Collaborate closely with stakeholders to understand business requirements and technical objectives.
- Lead the implementation and validation of the Microsoft Fabric POC, ensuring alignment with enterprise architecture and data strategy.
- Evaluate and demonstrate the capabilities of Microsoft Fabric in real-world scenarios.
2. Data Pipeline Design & Development
- Design and build scalable, efficient, and secure data pipelines using:
- Azure Synapse Analytics
- Azure Data Factory
- Azure Data Lake Storage
- Microsoft Fabric Dataflows and Lakehouses
- Ensure seamless integration of structured and unstructured data from diverse sources (on-prem, cloud, APIs, etc.).
3. Data Integration & Transformation
- Develop robust ETL/ELT processes to cleanse, transform, and enrich data for analytics and reporting.
- Optimize data ingestion and transformation workflows for performance and reliability.
- Implement real-time and batch data processing strategies.
4. Technical Guidance & Best Practices
- Provide architectural and technical guidance to internal teams and stakeholders.
- Establish and promote coding standards, version control practices, and CI/CD pipelines for data engineering.
- Mentor junior engineers and contribute to knowledge sharing across teams.
5. Data Governance & Metadata Management
- Implement data governance frameworks using Microsoft Purview:
- Metadata cataloguing
- Data lineage tracking
- Access control and policy enforcement
- Ensure compliance with data privacy and security standards.
6. Code Review & Optimization (Bonus)
- Utilize tools like Databricks AI Assistant, Pylint, and other linters to review and optimize code quality.
- Collaborate with cross-functional teams to streamline branching and merging strategies.
Required Skills & Qualifications:
- 9 to 12 years of experience in data engineering or related roles.
- Strong hands-on experience with Microsoft Fabric, Azure Synapse, Data Factory, and Azure Data Lake.
- Proficiency in SQL, Python, and PySpark.
- Experience with Databricks is highly desirable.
- Familiarity with Microsoft Purview for data governance.
- Strong understanding of data architecture, ETL/ELT design patterns, and cloud-native data solutions.
- Excellent communication and collaboration skills.
Preferred Qualifications:
- Microsoft certifications in Azure Data Engineering or Fabric.
- Experience in implementing POCs and presenting technical findings to stakeholders.
- Exposure to Agile methodologies and DevOps practices.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.