Project Manager III

• The MT/QE Evaluations Project Manager will support the design, execution, and analysis of evaluation frameworks for MT (Machine Translation) and QE (Quality Estimation) Models.
• This role focuses on ensuring statistically sound evaluations, high-quality datasets, and the generation of actionable insights.
• Running evaluations that assess MT and QE performance and risk, connecting linguistic quality frameworks with data analysis.
• Demonstrable experience in NLP/ML Evaluations, or Localization Analytics.
• Knowledge of evaluation design & statistical analysis, including determining statistically significant sample sizes.
• Experience with benchmarking against human judgments and applying MT & QE evaluation metrics.
• Skilled in analysing evaluation results, ensuring findings are reliable and actionable.
• Proficiency with data analysis and visualization tools (e.g. Python, Tableau).
• Highly organized, analytical, detail-oriented, and methodical.
• Strong communication skills able to communicate effectively with both technical and business audiences.
• Ability to explain technical results in a clear and understandable manner.
• Strong eye for patterns, anomalies, and trends across large datasets.

Benefits via Pride Global

Eligible employees receive:

• Medical, dental, and vision insurance
• 401(k) retirement savings
• Life and disability insurance
• Accident & critical illness coverage
• Legal and employee assistance programs (EAP)
• Pet, auto, and home insurance
• Discounts with preferred vendors