Search Jobs | Dice.com

2348 results (144 new)

Group by company

QA Lead/Ai Test Engineer

Raas Infotek LLC

Remote • Today

Easy Apply

Contract

Depends on Experience

QA Lead- AI / Automation Testing ::: FTE ::: Remote

REDLEO SOFTWARE INC.

Remote • 24d ago

Easy Apply

Full-time

110,000 - 120,000

Test Engineer/QA Lead

TechFlow, Inc.

Montgomery, Alabama • Today

Full-time

Urgent Needed - AI Test Engineer for Sunnyvale, California

SATCON Inc

Hybrid in Sunnyvale, California • Today

Easy Apply

Contract

Depends on Experience

Senior AI Test Engineer (API & AI Validation)

Techridge, Inc.

Houston, Texas • 4d ago

Easy Apply

Contract, Third Party

$60 - $70

Software Engineer AI/ML QA Engineer

Lumen Solutions Group Inc.

Hybrid in Columbia, Maryland • Today

Easy Apply

Contract

Depends on Experience

AI Quality Analyst-# 26-22273

U.S. Tech Solutions Inc.

Hybrid in Lincolnshire, Illinois • 18d ago

Easy Apply

Contract

$55 - $56

Test Lead – QA with AI

Momento USA LLC

Chicago, Illinois • Today

Easy Apply

Contract, Third Party

Depends on Experience

Lead Test Automation Engineer

Capgemini America, Inc.

Hybrid in New York, New York • Today

Easy Apply

Full-time

$100,000 - $115,000

Senior Test Analyst / QA Lead (Pension & Legacy Modernization Programs)

Projas Technologies, LLC

Sacramento, California • Today

Easy Apply

Contract, Third Party

Depends on Experience

AI Quality Engineer - Lead

LANDMARKIT LLC

Hybrid in New York, New York • Today

Easy Apply

Contract

Depends on Experience

Lead/Principal Quality Test Automation Engineer with Strategic Mindset - HYBRID

Yoh - A Day & Zimmerman Company

Boston, Massachusetts • Today

Easy Apply

Full-time

Competitive

Lead QA Test Analyst

Kforce Technology Staffing

Columbus, Ohio • Today

Contract

$78 - $80 hourly

Software Quality & Test Lead Engineer

Intuitive Machines LLC

Houston, Texas • Today

Full-time

Quality Assurance Test Lead

Eliassen Group

Englewood, Colorado • Today

Contract

QA Automation Test Engineer II

Randstad Digital

Remote or Arkansas • Today

Contract

USD47 - USD57

AI QA and Test Engineer

Software Guidance & Assistance

Atlanta, Georgia • Today

Contract

USD 50.34 - 50.34 per hour

Quality Engineer AI & Test Automation - F2F in GA

Government Systems Technologies Inc. (GSTi)

Atlanta, Georgia • 6d ago

Easy Apply

Third Party, Contract

Depends on Experience

Lead Test & Quality Engineer

Booz Allen Hamilton

Remote • Today

Full-time

USD 112,800.00 - 257,000.00 per year

AI QA Lead

Hexaware Technologies, Inc

Charlotte, North Carolina • 7d ago

Easy Apply

Full-time

$110,000 - $130,000

Visa Independent - AI Quality Engineering Lead - Local to NY/NJ

Octans Group LLC

Hybrid in New York, New York • Today

Easy Apply

Third Party, Contract

Depends on Experience

AI QA Automation Test Engineer -- W2 Role

Pilvi Systems

Richmond, Virginia • 3d ago

Easy Apply

Contract

Depends on Experience

QA Test Lead with Loan IQ Migration Experience

IT-SCIENT

Hybrid in New York, New York • Today

Easy Apply

Contract

Depends on Experience

Lead Test Automation Engineer

Symetra Financial

Remote • Today

Full-time

USD 106,400.00 - 177,300.00 per year

Lead Software Developer in Test - QA

Motion Recruitment Partners, LLC

Boston, Massachusetts • Today

Easy Apply

Full-time

$130000 - $175000

Lead Test Automation Engineer

Symetra Financial

Remote or Bellevue, Washington • Today

Full-time

USD 128,700.00 - 214,600.00 per year

Sr. Software Development Engineer In Test - Siri AI Quality

Apple, Inc.

Cupertino, California • Today

Full-time

AI Test Automation Engineer - Regrello

Cayuse Holdings

Phoenix, Arizona • Today

Full-time

USD 80.00 - 90.00 per hour

Sr Test Engineer - Software Quality Assurance

General Dynamics

Pittsfield, Massachusetts • Today

Full-time

USD 90,000.00 - 100,000.00 per year

AI/ML Software Test Engineer (GenAI & Chatbot Solutions)

System One

Hybrid in Columbia, Maryland • 17d ago

Easy Apply

Contract

$62.4

Job Details

Skills

Virtualization
Test Management
Test Strategy
TestRail
Testing
Training
Sprint
Stakeholder Management
System On A Chip
Test Cases
Vertex
Test Plans
TypeScript
UI
Unsupervised Learning
Vector Databases
SaaS
Scrum
Selenium
Semantics
Software Development Methodology
Regulatory Compliance
Reporting
Risk Assessment
QA Management
Quality Assurance
Recruiting
Regression Analysis
OWASP
POSTMAN
Performance Testing
Productivity
Python
Management
Mentorship
Microservices
Microsoft Azure
SAFE
Log Analysis
Machine Learning (ML)
Machine Learning Operations (ML Ops)
NoSQL
KPI
Kubernetes
LangChain
LangSmith
Leadership
LlamaIndex
ISO/IEC 27001:2005
ISTQB
JIRA
Java
JavaScript
Jenkins
GitLab
Good Clinical Practice
Google Cloud Platform
GraphQL
Health Care
Drive Testing
Electronic Commerce
Engineering Design
Evaluation
Database
Design Patterns
DevOps
Docker
Documentation
Cypress
Data Management
Data Quality
Data Science
Data Validation
Collaboration
Communication
Continuous Delivery
Continuous Integration
Appium
Artificial Intelligence
Zephyr
Automated Testing
API
Cloud Computing
GitHub
SQL
STLC
Agile
Amazon SageMaker
Amazon Web Services
Apache JMeter
BFSI

Virtualization
Test Management
Test Strategy
TestRail
Testing
Training
Sprint
Stakeholder Management
System On A Chip
Test Cases
Vertex
Test Plans
TypeScript
UI
Unsupervised Learning
Vector Databases
SaaS
Scrum
Selenium
Semantics
Software Development Methodology
Regulatory Compliance
Reporting
Risk Assessment
QA Management
Quality Assurance
Recruiting
Regression Analysis
OWASP
POSTMAN
Performance Testing
Productivity
Python
Management
Mentorship
Microservices
Microsoft Azure
SAFE
Log Analysis
Machine Learning (ML)
Machine Learning Operations (ML Ops)
NoSQL
KPI
Kubernetes
LangChain
LangSmith
Leadership
LlamaIndex
ISO/IEC 27001:2005
ISTQB
JIRA
Java
JavaScript
Jenkins
GitLab
Good Clinical Practice
Google Cloud Platform
GraphQL
Health Care
Drive Testing
Electronic Commerce
Engineering Design
Evaluation
Database
Design Patterns
DevOps
Docker
Documentation
Cypress
Data Management
Data Quality
Data Science
Data Validation
Collaboration
Communication
Continuous Delivery
Continuous Integration
Appium
Artificial Intelligence
Zephyr
Automated Testing
API
Cloud Computing
GitHub
SQL
STLC
Agile
Amazon SageMaker
Amazon Web Services
Apache JMeter
BFSI

Summary

Job Description: QA Lead / AI Test Engineer

Experience: 11+ years (min. 3 years leading QA teams; 2+ years testing AI/ML or LLM-based systems)
Employment Type: Full-time (Contract W2 only)

About the Role

We are looking for a QA Lead / AI Test Engineer to own quality strategy across our software products and AI-powered features. You will lead a team of QA and SDET engineers, drive test automation at scale, and define how we validate non-deterministic systems such as ML models and LLM applications. You will work closely with engineering, data science, product, and DevOps to ship reliable, safe, and high-quality releases.

Key Responsibilities

Quality Leadership

Define and own the end-to-end test strategy, test plans, and quality metrics (defect leakage, escape rate, coverage, MTTR).
Lead, mentor, and grow a team of QA engineers and SDETs; run hiring, performance reviews, and upskilling.
Act as the quality gatekeeper for releases: go/no-go decisions, risk assessment, and release readiness reporting.
Partner with product and engineering in requirement reviews, shift-left practices, and sprint planning.

Test Automation & Engineering

Design and maintain scalable automation frameworks for UI, API, mobile, and performance testing.
Integrate automated suites into CI/CD pipelines with quality gates, parallel execution, and reporting.
Drive contract testing, service virtualization, and test data management strategies.
Champion code quality in test code through reviews, design patterns, and reusable libraries.

AI/ML & LLM Testing

Build evaluation frameworks for ML models and LLM-based features (chatbots, RAG pipelines, copilots, agents).
Design test approaches for non-deterministic outputs: golden datasets, semantic similarity, LLM-as-judge, and human-in-the-loop evaluation.
Test for hallucination, bias, toxicity, prompt injection, jailbreaks, data leakage, and robustness.
Validate model performance (accuracy, precision/recall, F1, latency, cost per request), drift, and regression across model or prompt versions.
Verify data quality and pipelines feeding training, fine-tuning, and retrieval systems.
Use AI tools to improve QA productivity: test case generation, self-healing tests, log analysis, and defect triage.

Performance, Security & Reliability

Lead performance, load, and resilience testing (including AI inference latency and throughput).
Collaborate with security teams on OWASP Top 10, OWASP LLM Top 10, and vulnerability testing.
Support production monitoring, observability, and post-release validation.

Governance & Process

Establish QA standards, documentation, and best practices across teams.
Ensure compliance with relevant standards (e.g., ISO 27001, SOC 2, GDPR, responsible AI guidelines).
Report quality KPIs and risks to senior leadership.

Required Qualifications

11+ years in software QA/testing, with at least 3 years in a lead or manager role.
Strong hands-on experience with automation tools such as Selenium, Playwright, Cypress, Appium, REST Assured, or Postman/Newman.
Proficiency in at least one language: Python, Java, or JavaScript/TypeScript.
Solid experience testing REST/GraphQL APIs, microservices, and event-driven systems.
Experience with CI/CD tools (Jenkins, GitHub Actions, GitLab CI, Azure DevOps) and containers (Docker, Kubernetes).
Working knowledge of performance testing tools (JMeter, k6, Gatling, or Locust).
Hands-on experience testing AI/ML or LLM-based applications, including evaluation metrics and dataset-driven testing.
Strong understanding of Agile/Scrum, SDLC/STLC, and test management tools (Jira, TestRail, Xray, Zephyr).
Excellent communication, stakeholder management, and people leadership skills.

Preferred Qualifications

Experience with LLM evaluation tools and frameworks such as DeepEval, Ragas, promptfoo, LangSmith, TruLens, or Giskard.
Familiarity with LangChain, LlamaIndex, vector databases, and RAG architectures.
Knowledge of ML concepts: supervised and unsupervised learning, model drift, feature pipelines, and MLOps (MLflow, Kubeflow, SageMaker, Azure ML, or Vertex AI).
Experience with cloud platforms (AWS, Azure, or Google Cloud Platform).
Exposure to red teaming and adversarial testing of AI systems.
Experience with SQL and NoSQL databases and data validation tools (Great Expectations, dbt tests).
ISTQB Advanced/Expert certification or an AI/ML certification.
Domain experience in [BFSI / Healthcare / E-commerce / SaaS, etc.].

Core Competencies

Strategic thinking with strong hands-on technical depth
Risk-based testing mindset
Data-driven decision making
Curiosity about emerging AI testing practices
Ability to influence without authority

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10477291
Position Id: 9090100
Posted 2 hours ago

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Remote

•

24d ago

AI Led Automation Testing : Fulltime role Remote (East/Central Coast) only QA Lead- 12+ years: Looking for a QA lead with 8+ years of experience in Quality Engineering, Test Automation, API/ UI testing CI/CD and AI-led testing, with strong technical leadership and the ability to defile and drive QA StrategyStrong experience in software quality engineering, test strategy, test planning, and QA leadership across enterprise applications. Ability to define and drive the overall Quality Engineering

Easy Apply

Full-time

110,000 - 120,000

QA Lead (Exp-10+ Years) with Agentic AI- Full Time Role

Remote or Hybrid in San Diego, California

•

3d ago

We are seeking an experienced QA Lead with strong Agentic AI / Generative AI testing experience to lead quality engineering initiatives for enterprise applications and AI-powered solutions. The ideal candidate will have strong experience in test strategy, QA leadership, automation, API/UI testing, CI/CD, and Agile methodologies, along with hands-on knowledge of Agentic AI, LLMs, RAG, AI agents, prompt engineering, tool/function calling, and AI evaluation. The candidate will be responsible for de

Easy Apply

Full-time

Depends on Experience

QA Automation Lead

Remote

•

11d ago

Title:QA Automation Lead Location: LATAM Remote Duration: 6+ month contract Compensation: Competitive, based on experience Work Requirements: Citizen of the country of employment or authorized to work in that country. QA Automation Lead OverviewWe're looking for an experienced QA Lead to oversee a team of five QA engineers while remaining hands-on with testing efforts. This person should be a strong technical leader who can mentor others, improve QA processes, and ensure high-quality software de

Easy Apply

Contract, Third Party

Depends on Experience

Manager, Software Quality Assurance (QA)

Remote

•

Today

Description & Requirements Maximus is currently seeking a Manager, Software Quality Assurance (QA). The Manager, Software Quality Assurance (QA) provides leadership for quality engineering and testing activities across large-scale healthcare technology programs. This role is responsible for defining and executing enterprise test strategies, overseeing quality governance, managing testing across Agile teams and external partners, and ensuring successful delivery of high-quality software solutions

Full-time

USD 108,200.00 per year