AI Databricks Architect

Hi,

Hope you are doing well.

Position: Data Scientist

Location: Remote

Job Description:

Client is looking for a Databricks expert with experience in AI/ML, LangGraph, LangChain, FastAPI, Apps, Lakebase, Lakeflow, Lakehouse, Zero Copy, and related areas.

Must-Have Skills:

• Databricks Lakehouse, Delta Lake, Unity Catalog
• Lakeflow, Lakebase, Zero Copy Cloning
• PySpark, Spark SQL
• AI/ML, GenAI, RAG, LLMs
• LangChain, LangGraph, Agentic AI
• FastAPI, REST APIs
• MLflow, MLOps
• Azure Databricks / AWS Databricks
• Vector Search, Embeddings, Model Serving

Responsibilities:

• Design and implement scalable Databricks Lakehouse solutions.
• Build GenAI/RAG applications using LangChain and LangGraph.
• Develop FastAPI-based AI services and APIs.
• Create Lakeflow pipelines and optimize data processing workloads.
• Deploy and monitor AI/ML models using MLflow.
• Implement governance, security, and performance best practices.