Search Jobs | Dice.com

Job Details

Skills

QA Automation
AI Engineering
Generative AI
LLMs
Ai Evaluation
Validation Frameworks
Python

Summary

Role: AI Test Automation Engineer
Location: Cupertino, CA or Austin, TX (Hybrid – Tue/Wed/Thu Onsite)
Duration: 6+ Months (Extendable)

Job Description

Seeking an AI Transformation Engineer with strong experience in Generative AI, LLMs, RAG and AI-powered application testing. The ideal candidate will drive AI quality initiatives, build AI evaluation frameworks, and ensure the reliability, accuracy, and performance of AI solutions. A solid QA automation background is required.

Key Responsibilities

Lead AI quality and transformation initiatives for AI-powered applications.
Design and implement automated validation frameworks for AI/LLM solutions.
Evaluate AI model performance, accuracy, reliability, and safety.
Develop AI testing and evaluation pipelines using Python.
Collaborate with AI/ML teams to improve AI application quality.

Required Skills

Strong experience in AI Engineering, Generative AI, and LLMs.
Experience building AI evaluation and validation frameworks.
Strong understanding of AI/ML concepts, prompt evaluation, and model testing.
QA automation background with tools such as Playwright and Selenium.
Proficiency in Python and CI/CD integration.

Note: The responsibilities outlined above are intended to provide a general overview of the role. Actual responsibilities may vary based on business priorities, project needs, and team requirements.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10216385
Position Id: 9041550
Posted 12 hours ago

Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Contact the job poster

Abdullah Krishnamoorthy

Recruiter @ Introlligent Inc.

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Austin, Texas

•

22d ago

Apple Content Solutions Team is looking for an outstanding Software experience for a project based on Generative AI. Candidate must show deep understanding of LLMs and should be able to integrate with LLMs while also leveraging it for day to day work. Strong Java and Python Foundation Extensive hands on in Java and Python Develop and maintain AI-driven automation solutions Track the effectiveness of AI automation solutions, continuously refining them based on user feedback and evolving requireme

Easy Apply

Contract

55+

Senior AI Automation Engineer

Remote

•

Today

Alignment Health is breaking the mold in conventional health care, committed to serving seniors and those who need it most: the chronically ill and frail. It takes an entire team of passionate and caring people, united in our mission to put the senior first. We have built a team of talented and experienced people who are passionate about transforming the lives of the seniors we serve. In this fast-growing company, you will find ample room for growth and innovation alongside the Alignment Health

Full-time

USD 172,364.00 - 258,547.00 per year

AI Tester / AI QA Analyst

No location provided

•

Today

POSITION OVERVIEW MCI is one of the fastest-growing tech-enabled business services companies in the USA, with a strong call center footprint and operations that extend across multiple countries. We deliver Customer Experience (CX), Business Process Outsourcing (BPO), and Anything-as-a-Service (XaaS) cloud technology solutions across a wide range of industries, including healthcare, retail, government, education, telecom, technology e-commerce, and financial services. Our contact centers are pow

Full-time

Data Scientist - Responsible AI

Remote

•

Today

Our vision for the future is based on the idea that transforming financial lives starts by giving our people the freedom to transform their own. We have a flexible work environment, and fluid career paths. We not only encourage but celebrate internal mobility. We also recognize the importance of purpose, well-being, and work-life balance. Within Empower and our communities, we work hard to create a welcoming and inclusive environment, and our associates dedicate thousands of hours to volunteerin

Full-time

USD 87,400.00 - 123,400.00 per year

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

QA

Skills

Summary

Dice Job Match Score™

Abdullah Krishnamoorthy

Similar Jobs

QA

Job Details

Skills

Summary

Dice Job Match Score™

Abdullah Krishnamoorthy

Similar Jobs