Apply Now

Data Annotation Engineer

Louisville, KY, US • Posted 23 hours ago • Updated 23 hours ago

Contract Corp To Corp

Contract W2

Contract Independent

12 Months

On-site

Depends on Experience

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

DATA ANNOTATION ENGINEER

Summary

Data Annotation Engineer
Location - Louisville, Kentucky (Day 1 onsite)
Pay Rate: Market- based on experience

We are looking for an Annotation Program Lead to manage our AI Quality Annotation Program. This individual will oversee the operational execution of human review activities that establish the gold-standard datasets used to measure conversational AI performance, safety, and compliance.
The ideal candidate combines strong program management skills with experience in quality assurance, data annotation operations, and stakeholder engagement.

Lead the day-to-day operation of the AI annotation program.
Manage a team of annotators responsible for reviewing customer conversations and AI interactions.
Develop annotation guidelines, procedures, and quality standards.
Establish calibration programs and quality assurance processes to ensure consistency across reviewers.
Partner with Data Scientists to create and maintain gold-standard datasets.
Monitor annotation accuracy, throughput, and quality metrics.
Coordinate reporting and deliverables for Legal, Compliance, Responsible AI, and executive stakeholders.
Manage annotation workflows and tooling including setting up annotation jobs, running data processing scripts, and testing annotation UIs for quality before job launch.
Plan capacity requirements to support seasonal increases in review volume.
Support future expansion into multilingual evaluation programs.
Identify process improvements that increase efficiency and annotation quality.

Bachelor's degree or equivalent experience in Linguistics/Psychology.
5+ years of experience in program management, operations, quality assurance, data labeling, or related fields.
Experience leading teams and managing operational workflows.
Strong organizational and stakeholder management skills.
Ability to analyze quality metrics and drive continuous improvement initiatives.
Excellent written and verbal communication skills.
Familiarity with Python/R, SQL and Excel. Should be familiar with running scripts on language data.
Strong organizational and stakeholder management skills.
Ability to analyze quality metrics and drive continuous improvement initiatives.
Excellent written and verbal communication skills.
Familiarity with Python/R, SQL and Excel. Should be familiar with running scripts on language data.

Experience supporting AI, machine learning, or data annotation programs.
Familiarity with Responsible AI, compliance, legal review, or governance processes.
Experience developing operational standards and quality frameworks.
Experience managing vendor or contractor resources.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10117909
Position Id: 26-19459
Posted 23 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Annotation Program Lead

Louisville, Kentucky

•

Today

We are looking for an Annotation Program Lead to manage our AI Quality Annotation Program. This individual will oversee the operational execution of human review activities that establish the gold-standard datasets used to measure conversational AI performance, safety, and compliance. The ideal candidate combines strong program management skills with experience in quality assurance, data annotation operations, and stakeholder engagement. Lead the day-to-day operation of the AI annotation program

Easy Apply

Third Party, Contract

Depends on Experience

Data Annotation Engineer, Onsite - 69893

Louisville, Kentucky

•

Today

Data Annotation Engineer, Onsite We have an immediate need for an experienced Annotation Program Lead with strong expertise in AI/ML quality programs, data annotation operations, program management, and quality assurance to lead the operational execution of human review activities that establish gold-standard datasets for conversational AI performance, safety, and compliance. This is an onsite position based in Louisville, Kentucky, requiring a candidate with deep experience in AI/ML or dat

Easy Apply

Contract

AI Data Annotation Lead

No location provided

•

Today

POSITION OVERVIEW MCI is one of the fastest-growing tech-enabled business services companies in the USA, with a strong call center footprint and operations that extend across multiple countries. We deliver Customer Experience (CX), Business Process Outsourcing (BPO), and Anything-as-a-Service (XaaS) cloud technology solutions across a wide range of industries, including healthcare, retail, government, education, telecom, technology e-commerce, and financial services. Our contact centers are pow

Full-time

SENIOR IT TECHNICALPROJECT MANAGER -AI

Remote

•

7d ago

Job Title: Senior IT Technical Project Manager - AI Location: Chicago, IL / Remote Job Type: Contract About the Role We are seeking a Senior IT Technical Project Manager to lead complex, enterprise artificial intelligence (AI) initiatives across a matrixed environment. In this role, you will own integrated planning, execution tracking, dependency management, and delivery governance from concept through production readiness. You will work closely with Data Science, Engineering, Product, QA, and

Easy Apply

Contract, Third Party

Depends on Experience

Search all similar jobs

More jobs at Tanisha Systems, Inc. in Louisville, KY