Tampa, Florida
•
Today
Tampa FL Job Description: >> Define and implement evaluation strategies and success metrics for AI agents. >> Assess task completion, correctness, groundedness, hallucination, tool usage, safety, consistency, and overall user experience of AI-driven systems. >> Build comprehensive test scenarios, including edge and adversarial cases. >> Develop automated evaluation pipelines leveraging deterministic checks, LLM-as-a-Judge techniques, and custom evaluators. >> Conduct detailed examination of age
Third Party, Contract
Depends on Experience