Senior Databricks AI Engineer/Data Scientist

Overview

Remote
Accepts corp to corp applications
Contract - W2
Contract - 06+ month(s)

Skills

NLP
AI/ML
LLM

Job Details

Title: Senior Databricks AI Engineer/Data Scientist

Location: Louisville, KY (Remote)

Type: Contarct

Key Responsibilities:

  • Design, build, and optimize AI/ML pipelines on Databricks, including compute management, Unity Catalog integration, and automated workloads.
  • Develop, deploy, and maintain machine learning models from concept to production, including hyperparameter tuning and performance monitoring.
  • Integrate and utilize OpenAI APIs to support advanced NLP, LLMs, and generative AI solutions.
  • Lead computer vision initiatives, including OCR-based automation and document intelligence.
  • Collaborate with cross-functional teams to translate business objectives into actionable data science solutions.
  • Ensure data quality, security, and compliance across all analytics workflows.

Required Qualifications:

  • Bachelor s or Master s degree in Computer Science, Data Science, Engineering, or related field.
  • At least 5 years of professional Python programming experience.
  • Minimum 3 years of hands-on experience with Databricks or similar cloud analytics platforms, including compute orchestration, Unity Catalog, and workload automation.
  • At least 3 years of experience integrating and developing solutions with OpenAI and LLM APIs.
  • Minimum 3 years of experience in applied machine learning, including lifecycle management from research to production deployment.
  • Hands-on expertise with Large Language Models (LLMs) and computer vision, particularly OCR technologies.
  • Strong experience with version control systems, especially GitHub.
  • Excellent communication, documentation, and problem-solving skills.

Preferred Qualifications:

  • Experience in data engineering (data pipeline development, ETL, data modeling).
  • Prior exposure to ServiceNow (cmdb, secops, etc)
  • Initial portfolio of AI projects (Candidate will work on at least 4 of these):
  • Project 1: Vulnerability Analysis at Scale (GenAI - GPT 4.0 & GPT-4 Mini 0)
  • Project 2: DGPO Data Quality (Machine Learning - Hyperparameter Tuning)
  • Project 3: PIRC Automation (GenAI - GPT 4.0 & GPT-4 Mini 0)
  • Project 4: IAE Email System (GenAI - GPT 4.0 & GPT-4 Mini 0)
  • Project 5: Dynamic Data Classification/Masking (presidio)
  • Project 6: Dynamic Meta Generation - AI Assistant across Databricks Unity Catalog
  • Project 7: Contract Technology Requirement Analysis (GenAI - GPT 4.0 & GPT-4 Mini 0)
  • Project 8: Predictive Intelligence (Portable codebase for predicting forecasting for IT Ops - (Neural Prophet/Prophet or (SARIMA))
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About VDart, Inc.