Overview
On Site
USD 50.00 - 55.00 per hour
Contract - W2
Skills
Vendor Management
Onboarding
Data Quality
Quality Assurance
Management
Collaboration
Research
Project Management
KPI
Training
Communication
Reporting
Software Engineering
Job Details
Job Description
Job Title: Annotation Project Specialist
Location: BUR or RED onsite
Key Responsibilities
Vendor Management & Delivery
Oversee annotation vendor performance, ensuring timely and high-quality data deliveries.
Track and report on vendor success metrics.
Coordinate onboarding & certification of new raters.
Guideline Implementation & Development
Ensure correct implementation of annotation guidelines.
Partner with researchers to develop, refine, and update annotation guidelines.
Quality Assurance & Data Quality
Uphold the researcher quality bar and high data quality standards.
Oversee DQA (Double Quality Assurance) processes and success.
Develop, review, and improve quality assurance processes.
Manage DQA resources and reporting.
Training & Coordination
Organize and deliver annotator training sessions.
Coordinate with annotation vendors for ongoing training and calibration.
Reporting & Communication
Report on annotation metrics and quality trends.
Provide monthly written updates.
Communicate expectations, progress, and changes with research and vendor stakeholders.
Skills:
Must Haves:
? 3+ years experience in annotation project management roles.
? Proven ability to write clear annotation guidelines and define KPIs for quality measurement.
? Experience training raters or annotators on guidelines and quality standards.
? Strong technical aptitude to navigate annotation UIs and communicate effectively with software engineers about pipeline issues.
? Excellent written and verbal communication skills, including the ability to document processes and report metrics clearly.
? Experience coordinating with vendors and cross-functional teams to ensure project success.
? Ability to work independently in a fast-paced, ambiguous environment.
Nice to Haves:
? Background or familiarity with software engineering concepts and troubleshooting.
Education:
Bachelor's degree or higher
Job Title: Annotation Project Specialist
Location: BUR or RED onsite
Key Responsibilities
Vendor Management & Delivery
Oversee annotation vendor performance, ensuring timely and high-quality data deliveries.
Track and report on vendor success metrics.
Coordinate onboarding & certification of new raters.
Guideline Implementation & Development
Ensure correct implementation of annotation guidelines.
Partner with researchers to develop, refine, and update annotation guidelines.
Quality Assurance & Data Quality
Uphold the researcher quality bar and high data quality standards.
Oversee DQA (Double Quality Assurance) processes and success.
Develop, review, and improve quality assurance processes.
Manage DQA resources and reporting.
Training & Coordination
Organize and deliver annotator training sessions.
Coordinate with annotation vendors for ongoing training and calibration.
Reporting & Communication
Report on annotation metrics and quality trends.
Provide monthly written updates.
Communicate expectations, progress, and changes with research and vendor stakeholders.
Skills:
Must Haves:
? 3+ years experience in annotation project management roles.
? Proven ability to write clear annotation guidelines and define KPIs for quality measurement.
? Experience training raters or annotators on guidelines and quality standards.
? Strong technical aptitude to navigate annotation UIs and communicate effectively with software engineers about pipeline issues.
? Excellent written and verbal communication skills, including the ability to document processes and report metrics clearly.
? Experience coordinating with vendors and cross-functional teams to ensure project success.
? Ability to work independently in a fast-paced, ambiguous environment.
Nice to Haves:
? Background or familiarity with software engineering concepts and troubleshooting.
Education:
Bachelor's degree or higher
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.