AI Engineer (Databricks)

Remote • Posted 3 hours ago • Updated 3 hours ago
Contract W2
Contract Corp To Corp
Contract Independent
12 Months
No Travel Required
Remote
50+
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Amazon Web Services
  • Artificial Intelligence
  • Collaboration
  • Databricks
  • Evaluation
  • Extraction
  • Generative Artificial Intelligence (AI)
  • Machine Learning (ML)
  • Machine Learning Operations (ML Ops)
  • Management
  • Microsoft Azure
  • Prompt Engineering
  • Semantics
  • Testing
  • Use Cases

Summary

Job Description:
Overview:
  • We are seeking an AI Engineer with hands-on experience designing, building, and deploying enterprise Generative AI solutions on Databricks.
  • The ideal candidate will have expertise in Retrieval-Augmented Generation (RAG), custom AI agents, document intelligence, vector search, evaluation frameworks, prompt engineering, and model serving.
  • The role involves working closely with business and technical stakeholders to develop scalable AI solutions that support real-world enterprise use cases.
 
Key Responsibilities:
  • Design and implement Generative AI and Agentic AI solutions.
  • Build and optimize RAG architectures and vector search solutions.
  • Develop custom AI agents and agent workflows.
  • Implement document parsing, information extraction, and document intelligence capabilities.
  • Create and maintain evaluation frameworks to assess AI solution quality, accuracy, and reliability.
  • Design prompts and optimize prompt engineering strategies.
  • Deploy and manage models using Databricks Model Serving and related MLOps capabilities.
  • Integrate AI solutions with enterprise data platforms and applications.
  • Collaborate with Data Engineers and Full Stack Developers to deliver end-to-end AI-powered products.
 
Required Skills:
  • AI / GenAI
  • Retrieval-Augmented Generation (RAG)
  • Custom AI agents / Agentic workflows
  • Prompt engineering
  • Evaluation frameworks (LLM-as-a-Judge, RAG evaluation, AI testing)
  • Information extraction and AI document parsing
  • Vector search
  • Model serving and inference APIs
  • AI governance and quality assessment
 
Databricks:
  • Databricks AI/ML Platform
  • Databricks Model Serving
  • MLflow
  • Delta Lake
  • Vector Search
  • Unity Catalog
  • PySpark
  • Databricks SQL
  • Lakehouse architecture
 
Technical Stack
  • Python
  • SQL
  • PySpark
  • Lang Chain / LangGraph / Semantic Kernel (preferred)
  • Azure and/or AWS
  • REST APIs
  • Cloud-native AI deployments
 
Preferred Qualifications:
  • Experience building production-grade AI solutions.
  • Experience deploying GenAI applications in regulated or enterprise environments.
  • Databricks certifications (Machine Learning, GenAI, Lakehouse Fundamentals).
  • Experience with multi-agent systems and enterprise AI architectures.
  • Strong understanding of evaluation, observability, and governance of AI solutions.
 
Ideal Candidate Profile:
  • The strongest match appears to be someone with a blend of:
  • Enterprise AI architecture experience.
  • Hands-on RAG and vector search implementation.
  • Databricks AI/ML platform expertise.
  • Custom AI agent development.
  • AI evaluation and governance frameworks.
  • Production deployment experience on Azure and/or AWS.
 
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91099306
  • Position Id: 9135562
  • Posted 3 hours ago
Contact the job poster
RM

Rajasekar Manoharan

Recruiter @ Lorvin Technologies

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.