MT/QE Evaluations Project Manager

Role Overview GenAI Solutions Engineer focused onevaluation, observability, and performance measurementof GenAI systems. Primary expectation: Ability toquantify, evaluate, and improve system performance Core Responsibilities 1. Evaluation & Metrics (Primary Focus) Define and measure:Accuracy (primary metric)Precision, recall, confusion metricsHallucination rateFaithfulness / groundingBuildground truth datasetsEvaluate retrieval:Precision@kRecall@kPerform:Prompt A/B testingBias reduction2. Evalu

Gen AI Engineer Location Mountain View, CA / Remote Mandatory Skills : GenAI Solutions Engineer focused onevaluation, observability, and performance measurementof GenAI systems.Ability toquantify, evaluate, and improve system performance Job Description Core Responsibilities 1. Evaluation & Metrics (Primary Focus) Define and measure: Accuracy (primary metric) Precision, recall, confusion metrics ,Hallucination rate Faithfulness / grounding Buildground truth datasets Evaluate retr

Role: AI QA Automation Engineer Location: Cupertino, CA OR Austin, TX (Hybrid T-W-T Onsite) Duration: 6 Months Job Description: QA Engineer focused on testing AI/ML systems and building automation frameworks to ensure model quality, reliability, and performance. Key Responsibilities Design and implement automated tests for AI/ML featuresValidate model outputs for accuracy, consistency, and edge casesBuild and maintain automation frameworks and evaluation pipelinesPerform data-driven testing for

Key ResponsibilitiesDesign and implement automated tests for AI/ML featuresValidatemodel outputsfor accuracy, consistency, and edge casesBuild and maintain automation frameworks and evaluation pipelinesPerformdata-driven testingfor datasets and model behaviorIdentify issues related to model performance, bias, and reliabilityNice to HaveExposure to LLMs or multimodal systemsUnderstanding of ML concepts and evaluation metricsExperience with Python and test automation tools