QA

Hybrid in Austin, TX, US • Posted 11 hours ago • Updated 3 hours ago
Contract W2
Contract Independent
6 Months
No Travel Required
Hybrid
55+
Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

  • QA Automation
  • AI Engineering
  • Generative AI
  • LLMs
  • Ai Evaluation
  • Validation Frameworks
  • Python

Summary

Role: AI Test Automation Engineer
Location: Cupertino, CA or Austin, TX (Hybrid – Tue/Wed/Thu Onsite)
Duration: 6+ Months (Extendable)

 

Job Description

Seeking an AI Transformation Engineer with strong experience in Generative AI, LLMs, RAG and AI-powered application testing. The ideal candidate will drive AI quality initiatives, build AI evaluation frameworks, and ensure the reliability, accuracy, and performance of AI solutions. A solid QA automation background is required.

 

Key Responsibilities

  • Lead AI quality and transformation initiatives for AI-powered applications.
  • Design and implement automated validation frameworks for AI/LLM solutions.
  • Evaluate AI model performance, accuracy, reliability, and safety.
  • Develop AI testing and evaluation pipelines using Python.
  • Collaborate with AI/ML teams to improve AI application quality.

 

Required Skills

  • Strong experience in AI Engineering, Generative AI, and LLMs.
  • Experience building AI evaluation and validation frameworks.
  • Strong understanding of AI/ML concepts, prompt evaluation, and model testing.
  • QA automation background with tools such as Playwright and Selenium.
  • Proficiency in Python and CI/CD integration.

 

Note: The responsibilities outlined above are intended to provide a general overview of the role. Actual responsibilities may vary based on business priorities, project needs, and team requirements.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10216385
  • Position Id: 9041550
  • Posted 11 hours ago
Contact the job poster
AK

Abdullah Krishnamoorthy

Recruiter @ Introlligent Inc.
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Austin, Texas

22d ago

Easy Apply

Contract

55+

Remote

Today

Full-time

USD 172,364.00 - 258,547.00 per year

No location provided

Today

Full-time

Remote

Today

Full-time

USD 87,400.00 - 123,400.00 per year

Search all similar jobs