
SumasEdge Corporation
Hybrid in Louisville, Kentucky • Today
Easy Apply
Contract, Third Party
Depends on Experience
195 results (11 new)

SumasEdge Corporation
Hybrid in Louisville, Kentucky • Today
Easy Apply
Contract, Third Party
Depends on Experience







Skillify Solutions
Remote or Hybrid in New York, New York • 10d ago
Easy Apply
Full-time, Third Party
120,000 - 150,000

We are seeking a Data Scientist to help build and maintain a robust evaluation framework for conversational AI systems. This role will focus on developing automated AI quality measurement solutions, including LLM-as-a-Judge systems, to assess hallucination rates, intent accuracy, transcript quality, and responsible AI metrics at scale.
As a key member of our AI Quality team, you will work closely with annotation specialists, product teams, and governance stakeholders to ensure our AI experiences are accurate, safe, compliant, and customer-centric.
🔢 Crunching numbers...
Hybrid in Louisville, Kentucky
•
Today
Job Description: We are seeking a Data Scientist to help build and maintain a robust evaluation framework for conversational AI systems. This role will focus on developing automated AI quality measurement solutions, including LLM-as-a-Judge systems, to assess hallucination rates, intent accuracy, transcript quality, and responsible AI metrics at scale. As a key member of our AI Quality team, you will work closely with annotation specialists, product teams, and governance stakeholders to ensure
Easy Apply
Contract
Depends on Experience
Louisville, Kentucky
•
Today
Data Scientist, Onsite We have an immediate need for an experienced Data Scientist with strong expertise in Generative AI, LLM evaluation, conversational AI, statistical analysis, and machine learning model validation to build and maintain robust evaluation frameworks for voice and chat-based AI systems. This is a onsite position based in Louisville, Kentucky, for a candidate with deep experience in Python, Data Science, Machine Learning, Generative AI/LLMs, conversational AI, voice-based
Easy Apply
Contract
Remote or New Jersey
•
Today
AI Evaluation Engineer Location: USA Remote Employment Type: Contract Position Summary We are seeking an AI Evaluation Engineer to establish and maintain the quality standards used to determine whether production AI and LLM systems are ready to launch. This role will build centralized evaluation frameworks, create golden datasets, establish measurable quality thresholds, audit AI evaluation results, and implement continuous production monitoring. The successful candidate will bring strong techn
Easy Apply
Contract, Third Party
Remote
•
Today
Title - Applied AI Safety & Evaluation ResearcherThe Personalization mission makes deciding what to play next easier and more enjoyable for every listener. From Blend to Discover Weekly, were behind some of Spotifys most-loved features. We built them by understanding the world of music and podcasts better than anyone else. Join us and youll help keep millions of users listening by making great recommendations for each and every one of them. We ask that our team members be physically located in C
Easy Apply
Contract
70 - 75