Need QA Lead with Gen AI - Mountain View, CA

Role: QA Lead Location: Mountain View, CA Duration: Long Term Contract
As a QA Lead, you will:

• Lead QA strategy and execution for voice and AI-driven call center applications in the HHS domain.
• Develop testing strategies for conversational AI (GenAI) experiences: context retention, policy accuracy, hallucination checks, and fallback behaviors.
• Collaborate with AI/ML teams to define evaluation datasets (golden sets), define testing coverage, and monitor regression.
• Create reusable test cases across multiple call flows and edge cases for eligibility interviews, application processing, and account updates.
• Drive test data creation, synthetic scenario generation, and manage tooling across multiple environments (UAT, staging, prod).
• Own defect lifecycle and work closely with Product, Engineering, and Business Process teams to prioritize and resolve issues.

Qualifications
Required Skills:

• 6+ years of experience in Quality Assurance with at least 2 years in a lead role.
• Strong hands-on experience in test automation frameworks.
• Understanding of conversational AI and GenAI evaluation methods: semantic similarity, grounding checks, behavior prediction.
• Knowledge of API testing and integration points.

Preferred Skills:

• Experience with GenAI test techniques (prompt evaluation, hallucination detection, golden datasets, guardrails).
• Experience testing in call centers, especially for government or regulated industries.
• Prior work with public sector or HHS programs (SNAP, TANF, Medicaid) is strongly preferred.
• Understanding of conversational AI and GenAI evaluation methods: semantic similarity, grounding checks, behavior prediction.
• Experience integrating QA into CI/CD pipelines.
• Familiarity with AI observability tools (e.g., LangSmith, Arize, Weights & Biases).
• Exposure to Genesys, NICE, or other contact center platforms.

Regards,

Radiantze Inc