QA

Hybrid in Cupertino, CA, US • Posted 9 hours ago • Updated 1 hour ago
Contract W2
6 Months
No Travel Required
Able to Sponsor
Hybrid
65+
Fitment

Dice Job Match Score™

👾 Reticulating splines...

Job Details

Skills

  • AI Quality
  • LLMs
  • Ai Engineering
  • Generative AI
  • AI Evaluation and Validation Frameworks
  • Python

Summary

Role: AI Test Automation Engineer
Location: Cupertino, CA or Austin, TX (Hybrid – Tue/Wed/Thu Onsite)
Duration: 6+ Months (Extendable)

 

Job Description

Seeking an AI Transformation Engineer with strong experience in Generative AI, LLMs, RAG and AI-powered application testing. The ideal candidate will drive AI quality initiatives, build AI evaluation frameworks, and ensure the reliability, accuracy, and performance of AI solutions. A solid QA automation background is required.

 

Key Responsibilities

  • Lead AI quality and transformation initiatives for AI-powered applications.
  • Design and implement automated validation frameworks for AI/LLM solutions.
  • Evaluate AI model performance, accuracy, reliability, and safety.
  • Develop AI testing and evaluation pipelines using Python.
  • Collaborate with AI/ML teams to improve AI application quality.

 

Required Skills

  • Strong experience in AI Engineering, Generative AI, and LLMs.
  • Experience building AI evaluation and validation frameworks.
  • Strong understanding of AI/ML concepts, prompt evaluation, and model testing.
  • QA automation background with tools such as Playwright and Selenium.
  • Proficiency in Python and CI/CD integration.

 

Note: The responsibilities outlined above are intended to provide a general overview of the role. Actual responsibilities may vary based on business priorities, project needs, and team requirements.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10216385
  • Position Id: 9041558
  • Posted 9 hours ago
Contact the job poster
AK

Abdullah Krishnamoorthy

Recruiter @ Introlligent Inc.
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Sunnyvale, California

Today

Full-time

USD 220,000.00 - 265,000.00 per year

Mountain View, California

Today

Full-time

USD 217,565.00 - 271,000.00 per year

Santa Clara, California

Today

Full-time

USD 201,300.00 - 352,300.00 per year

Santa Clara, California

Today

Full-time

USD 279,100.00 - 488,400.00 per year

Search all similar jobs