Search Jobs | Dice.com

7 results (1 new)

Group by company

Data Annotation Program Lead

SumasEdge Corporation

Louisville, Kentucky • Today

Easy Apply

Third Party, Contract

Depends on Experience

Lead Data Engineer

General Dynamics

Remote • Today

Full-time

USD 128,039.00 - 173,229.00 per year

MMIS Data & Analytics Reporting Lead

ec3 Federal Services

Remote • 2d ago

Easy Apply

Full-time

Depends on Experience

Principal Technical Lead Manager - AI Data Applications

Motional

Remote or Boston, Massachusetts • Today

Full-time

USD 240,000.00 - 330,000.00 per year

Lead Data Engineer

3M Company

Remote or Minnesota • Today

Full-time

USD 188,251.00 - 230,084.00 per year

Encounter Data AI & Automation Lead

Humana Inc

Remote • Today

Full-time

USD 94,900.00 - 130,500.00 per year

Data Architecture Lead

Deckers Brands

Remote or California • Today

Full-time

USD 122,300.00 - 165,000.00 per year

Job Details

Skills

AI
Annotation
program management
Python
R
SQL
Data annotation

Summary

We are looking for an Annotation Program Lead to manage our AI Quality Annotation Program. This individual will oversee the operational execution of human review activities that establish the gold-standard datasets used to measure conversational AI performance, safety, and compliance.

The ideal candidate combines strong program management skills with experience in quality assurance, data annotation operations, and stakeholder engagement.

Lead the day-to-day operation of the AI annotation program.

Manage a team of annotators responsible for reviewing customer conversations and AI interactions.

Develop annotation guidelines, procedures, and quality standards.

Establish calibration programs and quality assurance processes to ensure consistency across reviewers.

Partner with Data Scientists to create and maintain gold-standard datasets.

Monitor annotation accuracy, throughput, and quality metrics.

Coordinate reporting and deliverables for Legal, Compliance, Responsible AI, and executive stakeholders.

Manage annotation workflows and tooling including setting up annotation jobs, running data processing scripts, and testing annotation UIs for quality before job launch.

Plan capacity requirements to support seasonal increases in review volume.

Support future expansion into multilingual evaluation programs.

Identify process improvements that increase efficiency and annotation quality.

Bachelor's degree or equivalent experience in Linguistics/Psychology.

5+ years of experience in program management, operations, quality assurance, data labeling, or related fields.

Experience leading teams and managing operational workflows.

Strong organizational and stakeholder management skills.

Ability to analyze quality metrics and drive continuous improvement initiatives.

Excellent written and verbal communication skills.

Familiarity with Python/R, SQL and Excel. Should be familiar with running scripts on language data.

Strong organizational and stakeholder management skills.

Ability to analyze quality metrics and drive continuous improvement initiatives.

Excellent written and verbal communication skills.

Familiarity with Python/R, SQL and Excel. Should be familiar with running scripts on language data.

Experience supporting AI, machine learning, or data annotation programs.

Familiarity with Responsible AI, compliance, legal review, or governance processes.

Experience developing operational standards and quality frameworks.

Experience managing vendor or contractor resources.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 90859492
Position Id: 9070357
Posted 6 hours ago

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Contact the job poster

Kumar Sai

Recruiter @ SumasEdge Corporation

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Annotation Engineer

Louisville, Kentucky

•

Yesterday

Data Annotation Engineer Location - Louisville, Kentucky (Day 1 onsite) Pay Rate: Market- based on experience We are looking for an Annotation Program Lead to manage our AI Quality Annotation Program. This individual will oversee the operational execution of human review activities that establish the gold-standard datasets used to measure conversational AI performance, safety, and compliance. The ideal candidate combines strong program management skills with experience in quality assurance, dat

Easy Apply

Contract, Third Party

Depends on Experience

Data Annotation Engineer, Onsite - 69893

Louisville, Kentucky

•

Today

Data Annotation Engineer, Onsite We have an immediate need for an experienced Annotation Program Lead with strong expertise in AI/ML quality programs, data annotation operations, program management, and quality assurance to lead the operational execution of human review activities that establish gold-standard datasets for conversational AI performance, safety, and compliance. This is an onsite position based in Louisville, Kentucky, requiring a candidate with deep experience in AI/ML or dat

Easy Apply

Contract

Data Scientist

Hybrid in Louisville, Kentucky

•

Today

We are seeking a Data Scientist to help build and maintain a robust evaluation framework for conversational AI systems. This role will focus on developing automated AI quality measurement solutions, including LLM-as-a-Judge systems, to assess hallucination rates, intent accuracy, transcript quality, and responsible AI metrics at scale. As a key member of our AI Quality team, you will work closely with annotation specialists, product teams, and governance stakeholders to ensure our AI experiences

Easy Apply

Contract, Third Party

Depends on Experience

Data Scientist

Hybrid in Louisville, Kentucky

•

Today

Job Description: We are seeking a Data Scientist to help build and maintain a robust evaluation framework for conversational AI systems. This role will focus on developing automated AI quality measurement solutions, including LLM-as-a-Judge systems, to assess hallucination rates, intent accuracy, transcript quality, and responsible AI metrics at scale. As a key member of our AI Quality team, you will work closely with annotation specialists, product teams, and governance stakeholders to ensure

Easy Apply

Contract

Depends on Experience

Job Details

Skills

AI
Annotation
program management
Python
R
SQL
Data annotation