Search Jobs | Dice.com

50 results (2 new)

Group by company

Senior Data Scientist AI Evaluation_Hybrid@Johnston,RI

BURGEON IT SERVICES LLC

Hybrid in Johnston, Rhode Island • Today

Easy Apply

Contract

Depends on Experience

Senior Data Scientist - Generative AI

Humana Inc

Remote • 8d ago

Full-time

USD 117,600.00 - 161,700.00 per year

Senior Data Scientist

Akshaya Inc

Remote • 22d ago

Easy Apply

Contract

Depends on Experience

Senior AI/ML Applied Scientist - Remote

UnitedHealth Group

Remote or Eden Prairie, Minnesota • Today

Full-time

USD 130,000.00 - 162,500.00 per year

Senior Data Scientist

Vanta

Remote • Today

Full-time

USD 172,000.00 - 202,000.00 per year

Sr Data Scientist - Remote

UnitedHealth Group

Remote or Minnetonka, Minnesota • Today

Full-time

USD 91,700.00 - 163,700.00 per year

Senior Data Scientist

SANS

Remote • Today

Easy Apply

Full-time

Depends on Experience

Senior Data Scientist (Consumer Technology space)

SANS

Remote • 15d ago

Easy Apply

Contract

$125 - $135

Sr AI Data Engineer

High Bridge Consulting

Remote • 12d ago

Easy Apply

Contract

$50 - $80

Senior Data and AI Specialist

Twilio

Remote • Today

Full-time

USD 106,320.00 - 132,900.00 per year

Senior AI Data Engineer

Samsara

Remote • Today

Full-time

USD 118,107.50 - 178,650.00 per year

Senior Data Scientist

Factspan Inc

Remote or Hybrid in Atlanta, Georgia • 13d ago

Easy Apply

Full-time

Depends on Experience

Senior AI Developer (Palantir AI Platform)

Vaco by Highspring

Remote • 14d ago

Easy Apply

Full-time

Depends on Experience

Sr. Manager Data Science - Gen AI and Content Systems

Reed Elsevier Technology Services

Remote or Raleigh, North Carolina • Today

Full-time

USD 118,300.00 - 219,800.00 per year

Sr. Manager Data Science - Gen AI and Content Systems

LexisNexis

Remote or Raleigh, North Carolina • Today

Full-time

USD 118,300.00 - 219,800.00 per year

Senior AI/ML Applied Scientist - Remote

UnitedHealth Group

Remote or Bellevue, Washington • Today

Full-time

USD 130,000.00 - 162,500.00 per year

Cloud Artificial Intelligence Security Lead

Kforce Technology Staffing

Remote or Tampa, Florida • Today

Contract

$76 - $99 hourly

Senior Machine Learning Engineer, Digital Twin Platform

Instacart

Remote • Today

Full-time

USD 240,000.00 - 253,500.00 per year

Lead AI/ML Engineer - Remote

UnitedHealth Group

Remote or Eden Prairie, Minnesota • 4d ago

Full-time

USD 145,500.00 - 249,500.00 per year

Senior AI Engineer

Crate and Barrel

Remote or Illinois • Today

Full-time

Senior Machine Learning Engineer

Amgen Inc

Remote • 5d ago

Full-time

USD 156,190.05 - 211,315.95 per year

Senior Python Engineer

Grid Dynamics Holdings, Inc

Remote • Today

Full-time

Senior/Principal RAN Digital Twin & AI Simulation Engineer

Parallel Wireless

Remote • Today

Full-time

Senior Lead, Full-stack Forward Deployed Engineer

Kyndryl

Remote or Dallas, Texas • Today

Full-time

USD 115,080.00 - 218,520.00 per year

AI/ML Technical Architect Lead

General Dynamics

Remote • Today

Full-time

USD 204,000.00 - 276,000.00 per year

Senior ML Engineer

Grid Dynamics Holdings, Inc

Remote • Today

Full-time

Senior Machine Learning Engineer

OneStudyTeam

Remote • Today

Full-time

USD 140,000.00 - 190,000.00 per year

Lead Decision Intelligence Engineer - NBA

Humana Inc

Remote • 8d ago

Full-time

USD 129,300.00 - 177,800.00 per year

Senior AI Engineer

The Chemours Company

Remote • Today

Full-time

USD 126,067.00 - 196,980.00 per year

Sr AI/ML Engineer with Medical Imaging

People Force Consulting Inc

Remote • Today

Easy Apply

Third Party, Contract

Job Details

Skills

Artificial Intelligence
Generative Artificial Intelligence (AI)
Evaluation
Machine Learning (ML)
NumPy
Financial Services
Interactive Voice Response
Python
Data Science

Summary

Role: Senior Data Scientist Generative AI / Conversational AI Evaluation
Location: Johnston, RI or Westwood, MA

Hybrid/Onsite preferred, though location flexibility may be considered

Domain: Cards, Banking, FSI

Description:

We are seeking an experienced Data Scientist to support the development and evaluation of AI-powered fraud self-service voice agents and conversational AI systems. The primary responsibility is not model deployment or engineering implementation, but designing evaluation frameworks, measuring system performance, identifying failure patterns, conducting root-cause analysis, and optimizing model behavior through data-driven experimentation.

Key Responsibilities

Design and execute evaluation frameworks for LLM, RAG, and multi-turn conversational AI systems.
Develop metrics to assess customer intent recognition, conversation quality, guardrail effectiveness, and business outcomes.
Analyze voice-agent interactions and identify areas of failure, drift, and performance degradation.
Perform prompt tuning and experimentation to improve model accuracy and reliability.
Conduct root-cause analysis of conversational failures and recommend remediation strategies.
Measure performance across different model configurations, prompts, and guardrail implementations.
Partner with AI Engineering and Product teams to validate solutions before production deployment.
Build dashboards and reports that communicate model effectiveness and operational impact.
Support fraud-related customer service use cases, including intent detection and multi-turn conversation flows.

Success Criteria

Develop reliable evaluation methodologies for conversational AI systems.
Quantify the effectiveness of fraud self-service voice agents.
Optimize prompts, retrieval strategies, and guardrails using empirical evidence.
Deliver actionable insights that improve customer experience and model performance.
Establish measurable KPIs for intent detection and multi-turn conversation success.

Mandatory Skills:

Strong background in Data Science, Machine Learning, Generative AI, or a related quantitative field.
Hands-on experience evaluating LLM, RAG, Agentic AI, or Conversational AI solutions.
Deep understanding of model evaluation techniques and metrics, including:

Precision@K
Recall@K
Mean Reciprocal Rank (MRR)
F1 Score
Retrieval and generation quality assessment

Experience performing experimentation, statistical analysis, and performance benchmarking.
Strong Python programming skills.
Experience with machine learning libraries and frameworks such as Scikit-learn, XGBoost, Pandas, NumPy, and related tools.
Ability to communicate technical findings succinctly to highly technical stakeholders.

Desired Skills:

Experience with:

Generative AI and LLM ecosystems
Multi-agent systems
RAG/Agentic RAG architectures
Amazon Bedrock
AWS SageMaker
Databricks
MLflow
LangSmith
Weights & Biases

Knowledge of conversational AI, IVR systems, digital assistants, and voice agents.
Experience in financial services, fraud detection, or customer service automation

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10500016
Position Id: 9086244
Posted 1 hour ago

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Hybrid in Westwood, Massachusetts

•

Today

Job Title: Senior Data Scientist Generative AI / LLM Evaluation Work Location: Johnston, RI or Westwood, MA (Hybrid)/Any Infosys Hub Office Contract duration: Long term contract Visa: / Only Domain (Industry) Cards, Banking, FSI Position Summary Job Details: We are seeking an experienced Data Scientist to support the development and evaluation of AI-powered fraud self-service voice agents and conversational AI systems. The primary responsibility is not model deployment or engineering imple

Easy Apply

Contract

Depends on Experience

Data Scientist - Conversational AI & Gen AI

Johnston, Rhode Island

•

Today

Position : Data Scientist - Conversational AI & Gen AI Location : Johnston, RI or Westwood, MA Duration: Full Time Domain (Industry): Cards, Banking, FSIMandatory skills Strong background in Data Science, Machine Learning, Generative AI, or a related quantitative field.Hands-on experience evaluating LLM, RAG, Agentic AI, or Conversational AI solutions.Deep understanding of model evaluation techniques and metrics, including:Precision @KRecall @KMean Reciprocal Rank (MRR)F1 ScoreRetrieval and ge

Easy Apply

Full-time

Depends on Experience

Senior Data Scientist - Worcester, Ma

Worcester, Massachusetts

•

Today

Job Opportunity An international developer of professional information products is seeking a Senior Data Scientist for its hybrid Worcester, Massachusetts team. This role will help define the analytical foundations of AI tools that assist users with research, interpretation, and document-driven decision making. The position calls for a senior practitioner who can connect data, algorithms, and product behavior. You will develop data science approaches for retrieval-grounded generation, intelligen

Easy Apply

Contract

$80 - $90

Principal Data Scientist

Boston, Massachusetts

•

30+d ago

Job Title : Principal Data Scientist Location : Boston ,MA Experience: 10 15+ years in Data Science & Applied ML, with 4+ years dedicated to Generative AI, LLMs, and Advanced Retrieval Systems Primary Objective : We are seeking a Principal Data Scientist specializing in Generative AI to serve as our top technical authority on model science, advanced retrieval methodologies, AI quality, and evaluation strategy. In this leadership role, you will define the scientific vision for our enterprise GenA

Easy Apply

Third Party, Contract

$60,000 - $80,000