AI Evaluation Engineer

AI Evaluation Engineer Location: USA Remote Employment Type: Contract Position Summary We are seeking an AI Evaluation Engineer to establish and maintain the quality standards used to determine whether production AI and LLM systems are ready to launch. This role will build centralized evaluation frameworks, create golden datasets, establish measurable quality thresholds, audit AI evaluation results, and implement continuous production monitoring. The successful candidate will bring strong techn

We are seeking a highly skilled Machine Learning Engineer who specializes in leveraging Large Language Models (LLMs) for automated evaluation and quality assessment. In this role, you will design and build systems that automatically measure and improve the accuracy, relevance, and consistency of model outputs. You will lead initiatives to create evaluation pipelines, develop metrics, and deliver actionable insights for continuous improvements. This position requires strong technical expertise, a

Hims & Hers is the leading health and wellness platform, on a mission to help the world feel great through the power of better health. We are redefining healthcare by putting the customer first and delivering access to care that is affordable, accessible, and personal, from diagnosis to treatment to delivery. No two people are the same, so we provide access to personalized care designed for results. By normalizing health & wellness challenges and innovating on their solutions, we're making bette

AI Product Analyst Pay Rate: $50-$65/hour About the Team and the Environment This role sits within a centralized AI Engineering and Automation Center of Excellence responsible for delivering enterprise-scale AI and automation solutions across a large, distributed North American organization. The AI work is real, deployed, and actively supporting business operations. This is not a pilot program or innovation lab. Current capabilities include: Reusable AI skills and plug-ins packaged into govern