Overview
Remote
USD 40.00 - 45.00 per hour
Contract - W2
Skills
Qualitative Analysis
Training
Reporting
Artificial Intelligence
Documentation
Quality Control
Quality Audit
Evaluation
Linguistics
Psychology
Attention To Detail
Analytical Skill
Critical Thinking
Communication
Job Details
Job Description
Title: AI Data Trainer - Generalist
Remote
Key Responsibilities:Label and evaluate conversations to identify examples of desired character traits and behaviors
Provide qualitative analysis of model behaviors and interaction patterns
Create and curate datasets for character training and evaluation
Identify and report novel trends, unexpected behaviors, or areas for improvement
Assist in developing benchmarks and evaluation criteria for AI character traits
Contribute to guidelines and documentation for character evaluation
Participate in regular calibration sessions with the team
Quality Standards:Maintain high levels of precision and consistency in data labeling
Follow annotation guidelines and quality control processes
Participate in regular quality audits and calibration exercises
Document clear rationales for evaluation decisions
Flag edge cases and provide detailed feedback on challenging examples
Required Qualifications:Bachelor's degree or equivalent experience in relevant field (e.g., linguistics, philosophy, psychology, communications)
Experience with content moderation, data labeling, or quality assessment
Strong attention to detail, analytical and critical thinking skills
Excellent written and verbal communication abilities
Ability to provide nuanced feedback on conversation quality and character traits
Comfortable working independently while maintaining consistent output quality
Title: AI Data Trainer - Generalist
Remote
Key Responsibilities:Label and evaluate conversations to identify examples of desired character traits and behaviors
Provide qualitative analysis of model behaviors and interaction patterns
Create and curate datasets for character training and evaluation
Identify and report novel trends, unexpected behaviors, or areas for improvement
Assist in developing benchmarks and evaluation criteria for AI character traits
Contribute to guidelines and documentation for character evaluation
Participate in regular calibration sessions with the team
Quality Standards:Maintain high levels of precision and consistency in data labeling
Follow annotation guidelines and quality control processes
Participate in regular quality audits and calibration exercises
Document clear rationales for evaluation decisions
Flag edge cases and provide detailed feedback on challenging examples
Required Qualifications:Bachelor's degree or equivalent experience in relevant field (e.g., linguistics, philosophy, psychology, communications)
Experience with content moderation, data labeling, or quality assessment
Strong attention to detail, analytical and critical thinking skills
Excellent written and verbal communication abilities
Ability to provide nuanced feedback on conversation quality and character traits
Comfortable working independently while maintaining consistent output quality
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.