Job Title: Data Architect – Data & AI Platforms (Databricks / Microsoft Fabric)
Experience: 15+ Years
Location: Iselin,NJ and Montvale,NJ
Job Type: Full-Time
Work Mode: [Onsite]
Job Summary
We are seeking a highly experienced Data Architect – Data & AI Platforms with 15+ years of experience in enterprise data architecture, modern data platforms, analytics, and emerging AI technologies.
The ideal candidate will bring deep architectural expertise in Azure Databricks, Delta Lake, Microsoft Fabric, Knowledge Graphs, Ontologies, and AI-ready data architectures.
This is a strategic architecture leadership role requiring the ability to define enterprise Data & AI vision, develop target-state architectures, establish technology roadmaps, and lead architecture teams in delivering scalable, secure, and intelligent data ecosystems.
The candidate must be a strong technology leader who can engage with senior client stakeholders, influence architectural decisions, and translate complex technology concepts into practical business outcomes.
Key Responsibilities
Data Architecture & Platform Leadership
- Lead enterprise-scale data architecture and modernization initiatives using Azure Databricks and Microsoft Fabric.
- Design scalable Lakehouse architectures, data integration, processing, and analytics solutions.
- Establish enterprise architecture standards, design principles, and reusable reference architectures.
- Drive performance optimization, scalability, security, governance, and cost efficiency.
AI-Ready Data Architecture & Context Engineering
- Define strategies to make enterprise data accessible and meaningful for Generative AI applications and AI agents.
- Design solutions using Knowledge Graphs, Ontologies, Semantic Models, and Metadata-driven architectures.
- Architect RAG, GraphRAG, Semantic Retrieval, and Context Engineering solutions.
- Establish secure and reusable patterns to expose enterprise data through APIs, tools, and agent integration mechanisms.
- Understand enterprise AI integration patterns, MCP, and agentic AI frameworks.
Databricks & Microsoft Fabric
- Provide deep architectural guidance on Databricks, Spark, Delta Lake, distributed processing, and Lakehouse architectures.
- Define Microsoft Fabric architecture leveraging OneLake, Lakehouse, Data Warehouse, and Semantic Models.
- Design interoperability and integration patterns between Databricks and Microsoft Fabric.
- Evaluate emerging data and AI technologies and recommend appropriate enterprise adoption strategies.
Strategy & Technology Roadmap
- Define the long-term Enterprise Data & AI Architecture Vision.
- Assess current data platform capabilities and identify architectural gaps.
- Develop target-state architectures and phased implementation roadmaps.
- Drive the evolution of traditional analytics platforms into AI-enabled enterprise data ecosystems.
- Align architecture decisions with business priorities, technology investments, and delivery feasibility.
Client Engagement & Leadership
- Serve as a trusted architectural advisor to client technology leadership and senior stakeholders.
- Lead architecture workshops, design reviews, and strategic technology discussions.
- Present architectural vision, technology recommendations, and trade-offs to technical and business audiences.
- Mentor and guide data architects and engineering teams.
- Drive architectural governance and influence enterprise-wide technology decisions.
Required Technical Skills & Experience
- 15+ years of experience in Data Engineering, Data Architecture, Enterprise Analytics, or related technology domains.
- Strong hands-on architectural expertise in Azure Databricks, Apache Spark, Delta Lake, and Lakehouse architecture.
- Strong working knowledge of Microsoft Fabric, including OneLake, Lakehouse, Data Warehouse, and Semantic Models.
- Experience designing enterprise-scale data platforms and modernization solutions.
- Strong understanding of Knowledge Graphs, Ontologies, RDF, Semantic Technologies, and Enterprise Data Modeling.
- Experience with Generative AI, RAG, GraphRAG, Semantic Search, and AI-ready data architecture.
- Understanding of agentic AI frameworks, MCP, and enterprise AI integration patterns.
- Strong knowledge of data governance, security, metadata management, lineage, and access control.
- Experience defining enterprise architecture strategies, target-state architecture, and technology roadmaps.
- Proven experience leading architecture teams and engaging with senior client stakeholders.
Preferred Qualifications
- Experience with Azure AI Search, Microsoft Foundry, and related Azure AI services.
- Knowledge of Microsoft Fabric IQ and emerging enterprise semantic/context platforms.
- Experience implementing ontology-driven or knowledge graph-based enterprise solutions.
- Familiarity with Power BI, enterprise semantic layers, and analytical data modeling.
- Experience in complex, globally distributed enterprise environments, preferably regulated industries.
- Experience presenting enterprise Data & AI strategies to CXOs and senior technology executives.
Key Technical Evaluation Areas
Candidates should have strong architectural knowledge and practical experience in:
- Azure Databricks, Delta Lake, ACID transactions, Time Travel, and MERGE.
- Apache Spark performance optimization and distributed processing.
- Microsoft Fabric architecture, OneLake, Lakehouse, and Data Warehouse.
- Databricks and Microsoft Fabric integration and data interoperability.
- Star Schema, Snowflake Schema, and Enterprise Semantic Modeling.
- Unity Catalog, Data Governance, Security, and Data Lineage.
- Knowledge Graphs, Ontologies, RDF, and Semantic Technologies.
- RAG, GraphRAG, Vector Search, and Context Engineering.
- AI Agents, MCP, and Secure Enterprise Data Access.
- CDC Pipelines, Incremental Processing, and Delta Lake Data Consistency.
Ideal Candidate Profile
We are looking for a senior technology leader who combines:
- Technical Depth: Expertise in Databricks, Microsoft Fabric, Enterprise Data Platforms, and AI-ready architectures.
- Strategic Vision: Ability to define next-generation Data & AI architecture and translate it into actionable roadmaps.
- Architectural Leadership: Ability to lead architects, establish technical direction, and drive enterprise architecture decisions.
- Client Influence: Excellent communication, executive presentations, stakeholder management, and technical storytelling skills.
Important: This is not just a Databricks or Microsoft Fabric technical specialist position. We are looking for a strategic Data & AI Architect who can own the architecture vision, lead technical teams, and act as a trusted advisor to enterprise clients.