Overview
On Site
Depends on Experience
Contract - Independent
Contract - W2
Skills
Agile
Analytics
Artificial Intelligence
Cloud Computing
Code Review
Collaboration
Communication
Continuous Delivery
Continuous Integration
Data Architecture
Data Engineering
Data Flow
Data Governance
Data Integration
Data Lake
Data Processing
Databricks
Design Patterns
DevOps
ELT
Enterprise Architecture
Extract
Transform
Load
Knowledge Sharing
Mentorship
Meta-data Management
Microsoft
Microsoft Azure
Optimization
POC
Presentations
Privacy
PySpark
Python
Real-time
Regulatory Compliance
Reporting
SQL
Unstructured Data
Version Control
Workflow
Job Details
Job Role: Microsoft Fabric with Azure
Location: NY/ NJ (Hybrid)
Rate: DOE
JD:
Resource with 10 to 12 years of experience.
Microsoft Fabric POC Implementation
- Collaborate closely with stakeholders to understand business requirements and technical objectives.
- Lead the implementation and validation of the Microsoft Fabric POC, ensuring alignment with enterprise architecture and data strategy.
- Evaluate and demonstrate the capabilities of Microsoft Fabric in real-world scenarios.
- Data Pipeline Design & Development
- Design and build scalable, efficient, and secure data pipelines using:
- Azure Synapse Analytics
- Azure Data Factory
- Azure Data Lake Storage
- Microsoft Fabric Dataflows and Lakehouses
- Ensure seamless integration of structured and unstructured data from diverse sources (on-prem, cloud, APIs, etc.).
- Data Integration & Transformation
- Develop robust ETL/ELT processes to cleanse, transform, and enrich data for analytics and reporting.
- Optimize data ingestion and transformation workflows for performance and reliability.
- Implement real-time and batch data processing strategies.
- Technical Guidance & Best Practices
- Provide architectural and technical guidance to internal teams and stakeholders.
- Establish and promote coding standards, version control practices, and CI/CD pipelines for data engineering.
- Mentor junior engineers and contribute to knowledge sharing across teams.
- Data Governance & Metadata Management
- Implement data governance frameworks using Microsoft Purview:
- Metadata cataloguing
- Data lineage tracking
- Access control and policy enforcement
- Ensure compliance with data privacy and security standards.
- Code Review & Optimization (Bonus)
- Utilize tools like Databricks AI Assistant, Pylint, and other linters to review and optimize code quality.
- Collaborate with cross-functional teams to streamline branching and merging strategies.
Required Skills & Qualifications:
- 10 to 12 years of experience in data engineering or related roles.
- Strong hands-on experience with Microsoft Fabric, Azure Synapse, Data Factory, and Azure Data Lake.
- Proficiency in SQL, Python, and PySpark.
- Experience with Databricks is highly desirable.
- Familiarity with Microsoft Purview for data governance.
- Strong understanding of data architecture, ETL/ELT design patterns, and cloud-native data solutions.
- Excellent communication and collaboration skills.
Preferred Qualifications:
- Microsoft certifications in Azure Data Engineering or Fabric.
- Experience in implementing POCs and presenting technical findings to stakeholders.
- Exposure to Agile methodologies and DevOps practices.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.