Apply Now

Quality Engineer (AI)

Atlanta, GA, US • Posted 2 days ago • Updated 3 hours ago

Contract W2

On-site

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

Test Automation
Regression Testing
quality metrics
test strategy
integration testing
Quality Engineering
QA Automation
Test Planning
Functional Testing
AI/ML Testing
AI observability
Quality Engineer (AI)
AI Performance Monitoring
Data Quality Testing
AI Quality Metrics / KPIs
Quality Engineer
AI Quality Engineer
AI Application Testing
Machine Learning Testing
Model Validation
AI Model Performance
Prompt Testing
Prompt Engineering Testing
AI Robustness Testing
AI Reliability Testing
Dataset Validation

Test Automation
Regression Testing
quality metrics
test strategy
integration testing
Quality Engineering
QA Automation
Test Planning
Functional Testing
AI/ML Testing
AI observability
Quality Engineer (AI)
AI Performance Monitoring
Data Quality Testing
AI Quality Metrics / KPIs
Quality Engineer
AI Quality Engineer
AI Application Testing
Machine Learning Testing
Model Validation
AI Model Performance
Prompt Testing
Prompt Engineering Testing
AI Robustness Testing
AI Reliability Testing
Dataset Validation

Summary

Solution IT Inc. is looking for Quality Engineer (AI) for one of its clients in Atlanta, GA

Job Title: Quality Engineer (AI)

Responsibilities:

Design and execute comprehensive test strategies for AI/ML-based applications and intelligent systems.
Validate AI model performance, accuracy, fairness, robustness, and reliability.
Develop automated testing frameworks for web, mobile, APIs, and AI-powered applications.
Create and execute test cases for model inference, prompt testing, hallucination detection, and response validation.
Perform functional, integration, regression, performance, and security testing.
Validate training datasets, model outputs, and data pipelines to ensure quality and consistency.
Collaborate with Data Scientists, AI Engineers, Product Managers, and Developers throughout the development lifecycle.
Monitor AI system behavior in production and identify quality improvement opportunities.
Define quality metrics, KPIs, and dashboards for AI solution performance.
Identify testing bottlenecks and implement process improvements.
Ensure compliance with responsible AI principles, privacy requirements, and organizational quality standards.
Support continuous integration and continuous testing within DevOps pipelines.

Required Skills:

Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
4+ years of experience in Software Quality Engineering, QA Automation, or Testing.
2+ years of experience testing AI/ML-based applications or data-driven systems.
Strong understanding of Software Testing Life Cycle (STLC) and SDLC.
Experience with test automation tools and frameworks.
Knowledge of machine learning concepts, model validation techniques, and data quality testing.
Experience in API, UI, and backend testing.
Strong analytical, troubleshooting, and problem-solving skills.

Excellent communication and collaboration skills.

Technical Skills

Quality Engineering
Test Strategy & Planning
Manual & Automated Testing
Functional & Regression Testing
API Testing
Performance & Security Testing
Defect Management

AI/ML Testing

Model Validation & Evaluation
Prompt Testing
Hallucination Detection
Bias & Fairness Testing
Data Validation & Data Quality Testing
AI Performance Monitoring

Automation Tools

Selenium
Playwright
Cypress
Postman
Rest Assured
JMeter

Programming

Python
Java
JavaScript/TypeScript

Cloud & DevOps

Azure / AWS / Google Cloud Platform
GitHub Actions
Azure DevOps
Jenkins
CI/CD Pipelines

Work Site: Atlanta, GA

Duration: 6 Months C2C

Expected Start Date: Immediate

Number of Positions: 01

Please send your responses back to

Thanks

Recruiting Team

SOLUTION IT INC

Work: / Extn 143 / 150

URL:
Confidentiality Notice: The material in this e-mail is intended only for the use of the individual to whom it is addressed and may contain information that is confidential, privileged, and exempt from disclosure under applicable law. If you are not the intended recipient(s), be advised that the unauthorized use, disclosure, copying, distribution, or the taking of any action in reliance on this information is strictly prohibited. If you have received this e-mail in error, please immediately contact the sender by reply email and destroy all copies of the original message. Thank you.

Under Bill s.1618 Title III passed by the 105th U.S. Congress this mail cannot be considered as "spam" as long as we include contact information and a remove link for removal from our mailing list. In order to not be in the recipients-list for this mail, please reply to us with "REMOVE" either in the subject or in the mail body. Please include all pertinent email addresses. Our apologies for any inconveniences caused by this mail.

to remove from our mailing list.
Solution IT, Inc, 60E Concord St, Wilmington, MA 01887 Phone: Fax:

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10290916
Position Id: 2026-13232
Posted 2 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

AI Engineer

Hybrid in Atlanta, Georgia

•

19d ago

AI Engineer GenAI Quality & EvaluationLocations: Oakdale, MN | Atlanta, GA | Scottsdale, AZ | St. Petersburg, FL | Omaha, NEWork Arrangement: Hybrid 3 days onsiteEmployment Type: Contract (C2C)Requirement: Candidates must be local to one of the listed locations. We are looking for an experienced AI Engineer with a background in software engineering, QA, automation testing, or business systems analysis. The ideal candidate should have at least one year of hands-on experience with Generative AI,

Easy Apply

Contract

65 - 70

Senior AI Test Engineer

Remote

•

4d ago

AI/GenAI Test EngineerAI Testing Engineer DeepEval & Langfuse Position OverviewWe are looking for an AI Testing Engineer with hands-on experience in testing and evaluating Generative AI/LLM applications. The ideal candidate should have strong experience with DeepEval, Langfuse, LLM evaluation, prompt testing, and AI quality validation. Key ResponsibilitiesDesign and execute testing strategies for Generative AI, LLM, RAG, and AI Agent applications.Perform LLM evaluation and quality testing using

Easy Apply

Contract

Depends on Experience

AI Tester / AI QA Analyst

No location provided

•

Today

POSITION OVERVIEW MCI is one of the fastest-growing tech-enabled business services companies in the USA, with a strong call center footprint and operations that extend across multiple countries. We deliver Customer Experience (CX), Business Process Outsourcing (BPO), and Anything-as-a-Service (XaaS) cloud technology solutions across a wide range of industries, including healthcare, retail, government, education, telecom, technology e-commerce, and financial services. Our contact centers are pow

Full-time

Sr Machine Learning Engineering Manager - AI Quality and Governance

Remote

•

Today

Join Workiva as aSr Machine Learning Engineering Manager - AI Quality and Governance and help establish how we build, evaluate, release, and operate trustworthy AI products at scale. You will lead a multidisciplinary team of software, machine learning, and quality engineers responsible for two connected missions: advancing end-to-end quality across Workiva's AI platform and products, and building shared evaluation and governance capabilities that make our AI systems measurable, observable, relia

Full-time

USD 193,000.00 - 308,000.00 per year

Search all similar jobs

More jobs at SolutionIT, Inc. in Atlanta, GA