AIT Global, Inc.
AIT Global, Inc.

Senior Data Scientist + Gen AI

Mountain View, CA, US • Posted 12 hours ago • Updated 12 hours ago
Contract Corp To Corp
Contract W2
On-site
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • python
  • azure
  • AI
  • Gen AI

Summary

Job Title: Senior Data Scientist + Gen AI
Location: Mountain View, CA
RAG pipelines leveraging LLMs
Prompt engineering (system prompts, tool prompts, function calling, versioning with evaluations)
Evaluation & observability, including:
  • Ground truth setup
  • Confusion metrics
  • Hallucination rate measurement
  • LLM-as-judge with human review
  • Cost & latency monitoring
  • Retrieval strategies & prompt patterns
  • Context management
  • Hallucination mitigation
  • Faithfulness & grounding validation
  • Agentic workflows
  • Multi-step reasoning
  • Tool orchestration
  • Agent success rate measurement
  • LangChain / LlamaIndex (or equivalent) proficiency
  • Cloud LLM providers
  • Azure OpenAI
  • AWS Bedrock
  • Vertex AI
  • Workflow orchestration
  • Airflow
  • Dagster
  • Security & privacy
  • PII handling
  • RBAC
  • Strong Python expertise with real production experience
  • Success Criteria
  • Production-ready prompt + RAG system
  • Measurable quality lift (accuracy, faithfulness, confusion metrics)
  • Reduced hallucinations
  • Repeatable evaluation harness
  • Observable system (quality, latency, cost, drift monitoring)
Skills:
  • Large Language Models, AWS, Prompt Engineering, Python, Machine Learning, Gen AI, Confluence, Jira
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10106248
  • Position Id: 2026-4597
  • Posted 12 hours ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
More jobs at AIT Global, Inc. in Mountain View, CA