Azure Data Architect & Agentic AI Architect

Title: Azure Data Architect with Agentic AI

Location: Remote, US

Duration: Long Term 

Experience: 15+ Years

Ideal Candidate: A forward-looking architect who can combine Azure Databricks + Data Engineering + Generative AI + Agentic AI to build autonomous, intelligent, governed, and scalable enterprise data ecosystems.

Job Description

We are looking for a highly experienced Azure Databricks & Agentic AI Architect to design and lead next-generation AI-powered data platforms. The ideal candidate will have 15+ years of Data & Analytics experience, strong Azure Databricks/Lakehouse expertise, and hands-on experience with Generative AI, Agentic AI, and AI-driven Data Engineering.

 Key Responsibilities

·         Design enterprise-scale Azure Databricks Lakehouse platforms using Delta Lake, Unity Catalog, ADLS Gen2, Databricks Workflows, and Delta Live Tables.

·         Lead the implementation of Agentic AI for autonomous data ingestion, mapping, transformation, data quality, metadata enrichment, lineage, testing, and pipeline optimization.

·         Design AI-driven Data Development Lifecycle (AI-DLC) solutions covering requirements, data modeling, code generation, testing, documentation, deployment, and monitoring.

·         Architect RAG-based GenAI solutions using enterprise data.

·         Design AI agent orchestration using Azure OpenAI, LangGraph, LangChain, Semantic Kernel, AutoGen, and MCP.

·         Build domain-specific AI agents for Data Engineering and Analytics teams.

·         Design self-healing data pipelines and AI-driven incident triage, failure prediction, SLA monitoring, capacity planning, and cost optimization.

·         Establish Human-in-the-Loop (HITL) frameworks and governance for autonomous AI agents.

·         Define enterprise AI governance covering security, observability, auditability, prompt governance, cost monitoring, and responsible AI.

·         Mentor architects, data engineers, and AI engineers.

·         Lead enterprise architecture discussions and communicate AI strategy and business value to senior/CXO stakeholders.