- Role Objective:
Design and implement next-generation, AI-powered data platforms using Azure Databricks and Agentic AI, driving autonomous, intelligent, and self-optimizing data engineering ecosystems.
- Technical Skills Required:
- Expertise in Azure Databricks, Delta Lake, Unity Catalog, Azure Data Factory.
- Experience with AI & Agentic frameworks: Azure OpenAI, LangChain, LangGraph, MCP Protocol, Vector Databases, AI Agent Orchestration.
- Proficiency in Data Engineering tools: PySpark, Spark SQL, Python, SQL, ELT/ETL modernization.
- DevOps/AI-DLC: Azure DevOps, GitHub Actions, CI/CD, MLOps, LLMOps, evaluation and AI testing frameworks.
- Leadership Expectations:
- Drive AI-first transformation in Data Engineering.
- Define and build enterprise-wide patterns, accelerators, and reusable AI agents.
- Mentor and guide architects, data engineers, and AI engineers.
- Lead strategic conversations with executives on AI adoption, ROI, and transformation strategies.
- Preferred Certifications:
- Databricks Certified Data Engineer Professional
- Databricks Certified Solution Architect
- Microsoft Azure Solution Architect (AZ-305)
- Azure Data Engineer (DP-203)
- Microsoft Applied Skills Azure OpenAI
- Generative AI / Agentic AI certifications
.
- Mandatory Skills: Azure, Databricks, Agentic AI, ETL, SQL, Data Engineering.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 10209652
- Position Id: 2026-229862
- Posted 19 hours ago