Databricks AI & Governance Engineer – Agentic AI / Data Governance
Location: Plano, TX — Hybrid (Dallas, Chicago, Atlanta, Charlotte, MN, Cupertino, or SFO also accepted)
Job Description:
We are seeking a Databricks AI & Governance specialist to design, develop, and deploy Agentic AI solutions that automate data governance, data quality, metadata management, lineage analysis, policy enforcement, and stewardship workflows across enterprise data platforms. This role builds scalable AI agents leveraging LLMs, RAG, and orchestration frameworks to support data management and regulatory compliance initiatives for a leading financial services client.
Key Responsibilities:
- Build autonomous and human-in-the-loop AI agents for data cataloging, business glossary management, policy compliance validation, data ownership assignment, and issue remediation
- Integrate AI agents with enterprise platforms including Ataccama, Collibra, Informatica, Microsoft Purview, Databricks, Snowflake, AWS, and Azure
- Partner with Data Governance Engineers, Data Engineers, Architects, and business stakeholders to define agent capabilities and align with enterprise data strategy
- Create proof-of-value demonstrations and pilot implementations to accelerate stakeholder adoption
- Implement monitoring, observability, guardrails, and governance controls for responsible AI practices
- Support proposal development, solution architecture, effort estimation, and client presentations
Required Qualifications:
- 8+ years in Data Management, Data Engineering, Data Governance, Metadata Management, or Enterprise Data Architecture
- 5+ years designing/implementing enterprise data governance, MDM, metadata management, data quality, or regulatory compliance solutions
- 3+ years developing AI/ML, Generative AI, or Agentic AI solutions using LLMs and orchestration frameworks
- 3+ years hands-on with Python and AI frameworks (LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, OpenAI, Azure AI Foundry, Amazon Bedrock, or equivalent)
- 3+ years with cloud platforms (Azure, AWS, or Google Cloud Platform)
- 2+ years integrating governance platforms (Collibra, Databricks Unity Catalog, or related)
- 2+ years designing APIs, workflow orchestration, event-driven architectures, or enterprise system integrations
- Experience defining governance policies, lineage workflows, data quality controls, and compliance monitoring
- Agile delivery experience with backlog-driven, iterative development
- Strong client-facing communication skills — workshops, requirements gathering, architecture reviews, executive demos
eye
Never miss an opportunity! Create an alert based on the job you applied for.
