Automation QA Engineer AI/ML & Agent Testing (Remote)

Remote • Posted 1 hour ago • Updated 1 hour ago
Contract Corp To Corp
Contract Independent
No Travel Required
Remote
$55 - $60/hr
Fitment

Dice Job Match Score™

📊 Calculating match score...

Job Details

Skills

  • Automated Testing
  • Artificial Intelligence
  • LangChain
  • Testing
  • CI/CD
  • Python
  • AI agents

Summary

We are looking for a QA Automation Engineer with AI testing experience, especially in LLM applications, RAG pipelines, and agent/multi-agent systems. This position is remote.

  • 10+ years in QA Automation Testing
  • 2+ years testing AI/ML or LLM applications
  • Python automation experience (TypeScript/JS is a plus)
  • Experience testing AI agents or multiagent systems
  • Handson with LangChain, LangGraph, crewAI, AutoGen, or similar
  • Strong experience with LLM evaluation metrics
  • Strong in performance testing (latency, reliability, resiliency)
  • Experience with distributed systems testing
  • CI/CD: GitHub Actions, Azure DevOps, or similar
  • Observability: OpenTelemetry, Datadog, Grafana, etc.
  • Experience with AI safety, guardrails, hallucination checks, PII handling
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91159728
  • Position Id: 8919052
  • Posted 1 hour ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

Today

Easy Apply

Contract, Third Party

Depends on Experience

Remote

Today

Easy Apply

Third Party, Contract

70 - 80

Remote

Yesterday

Easy Apply

Third Party, Contract

Depends on Experience

Remote

Today

Contract

80-105/hr

Search all similar jobs