Automation QA Engineer with AI/LLM_Alpharetta, GA- Onsite- Only Locals
American IT Systems
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Automation QA Engineer
Summary
Automation QA Engineer with AI/LLM
Alpharetta, GA- Only Locals
6+ Months
Experience: 10+ years
Tech Stack: Python/JavaScript, Test Automation, Pytest/Selenium, LLM Evaluation, Jira/Test Management
Job Description:
- Design and execute test cases for multi-turn agent conversations.
- Build evaluation frameworks to assess LLM quality.
- Automate API and UI testing.
- Create regression suites for agentic outputs.
- Drive test coverage and quality metrics.
- Develop automated testing frameworks using Python/JavaScript, Pytest, Selenium, or similar technologies.
- Validate AI/LLM responses and agent behavior against defined quality criteria.
- Track defects and test results using Jira or other test-management tools.
- Dice Id: 91163020
- Position Id: 2026-1689/45849
- Posted 2 days ago
Company Info
About American IT Systems
American IT Systems Staffing Fastest growing Recruitment firm helping clients hire the best quality candidates faster across the globe.
We provide services starting from Temporary Staffing & Permanent Recruitment to management consulting. We specialize in Technology, Product & Design hiring headhunting & sourcing passive resources using cutting edge technology & tools
Our Aim
Hiring and recruiting top talent can be a challenging, time-intensive process. Client organizations recognize the value in saving time, money and preventing unnecessary burden on internal staff by outsourcing certain hiring needs. It can also send a strong message to top professionals they will spare no expense in finding and hiring the best talent possible..
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs