108 results (1 new)
CACI International, Inc.
Remote or Arlington, Virginia • Today
Full-time
USD 75,200.00 - 158,100.00 per year
Crown Consulting, Inc.
Remote or Arlington, Virginia • Today
Full-time
USD 100,000.00 - 150,000.00 per year
108 results (1 new)
CACI International, Inc.
Remote or Arlington, Virginia • Today
Full-time
USD 75,200.00 - 158,100.00 per year
Crown Consulting, Inc.
Remote or Arlington, Virginia • Today
Full-time
USD 100,000.00 - 150,000.00 per year
Job Title: AI Test Engineer
Location: 100% Remote
Visa: Any
Interview Process: Video (2 Rounds)
Work Schedule: 100% Remote
Job Description:
12+ years of experience
Define the end-to-end test strategy for non-deterministic systems: golden datasets, LLM-as-judge evals, regression suites, and human review loops.
Build automated evaluation harnesses measuring accuracy, groundedness, toxicity, bias, latency, and multimodal quality (speech recognition accuracy, image understanding, voice naturalness).
Conduct adversarial and red-team testing: jailbreaks, prompt injection, data leakage, and edge cases across languages, accents, and accessibility needs.
Automate functional, performance, and load testing across browsers, iOS, and Android, integrated as quality gates in CI/CD.
Test Harness, DeepEvals, Playwright, Mabl, QAwolf, and other AI testing tool experience is required.
Track defect trends and release-readiness metrics, and report quality risks clearly to engineering and the project manager.
SDH Systems is a team of creatives with experience in design, content, vision and mission. Using these skills we create creative assets.
We always ensure that our software solutions help your business/organization to enhance their productivity by providing you the unmatched developement solutions tailored to suit your needs. Most of our team has on the job experience in more than one medium, so that we can integrate these to build a creative identity.
To see how well you match this job, please log in or create an account.
Once logged in, be sure to complete your profile to get the most accurate match score.
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs