Apply Now

QA Engineer – AI

New York, NY, US • Posted 12 hours ago • Updated 12 hours ago

Contract Corp To Corp

Contract Independent

75% Travel Required

On-site

60+

Fitment

Dice Job Match Score™

🫥 Flibbertigibetting...

Job Details

Skills

API QA
Accessibility
Agile Testing
Artificial Intelligence
Automated Testing
Continuous Improvement
Data Quality
Documentation
Durable Skills
Evaluation
Functional Requirements
JIRA
Machine Learning (ML)
Manual Testing
POSTMAN
Performance Testing
Quality Assurance
Regression Analysis
Selenium
Test Cases
Test Plans
Testing
UI
Web Services

Summary

Tests AI model outputs and application functionality. Validates data accuracy, business logic and system performance.Key Resposibilities:- Design and execute test plans covering AI model outputs, data correctness, and application functionality.- Create automated tests for APIs and UI where appropriate; maintain regression suites.- Validate business logic, edge cases, and non-functional requirements (performance, reliability).- Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).- Triage defects, document reproducible steps, and partner with engineers to resolve issues.- Contribute to release readiness, quality gates, and continuous improvement of testing practices.Required Qualifications:- 3+ years in QA/Test Engineering for web/services-based applications.- Experience with test automation tools (Selenium) and API testing (Postman or similar).- Strong understanding of test case design, defect lifecycle, and agile QA practices.- Familiarity with tracking tools (JIRA) and test documentation.- Ability to reason about data quality and validate outputs against requirements.Preferred Nice to have:- Experience testing ML/LLM systems: evaluation datasets, prompt regressions, safety checks.- Performance testing experience (load, stress) and observability basics.- Knowledge of accessibility testing for UI.Core Skills:Selenium, Postman, Test Cases, JIRA, Manual Testing

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91099306
Position Id: 8934254
Posted 12 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

AI Quality Engineer

New York, New York

•

14d ago

AI Agent Test Scenario Creation: Designing robust and relevant test scenarios to validate AI agent behavior and performance. PRD Analysis: Analyzing Product Requirement Documents (PRDs) to extract testing requirements and ensure comprehensive test coverage. Performance Testing: Conducting thorough performance testing of AI systems to identify bottlenecks and ensure scalability. Agentic Testing: Utilizing agentic coding tools such as Windsurf, Claude Code, and Cursor for advanced automation

Easy Apply

Full-time, Contract, Third Party

$TBD

AI Quality Engineer

New York, New York

•

Today

JOB TITLE: AI Quality Engineer #1 Duration: 6-9 Months Location: NYC. NY Tasks & Duties: AI Agent Test Scenario Creation: Designing robust and relevant test scenarios to validate AI agent behavior and performance. PRD Analysis: Analyzing Product Requirement Documents (PRDs) to extract testing requirements and ensure comprehensive test coverage. Performance Testing: Conducting thorough performance testing of AI systems to identify bottlenecks and ensure scalability. Agentic Tool: Utilizing age

Easy Apply

Full-time, Contract

Quality Automation Engineer ( Mobile Apps Testing)

Hybrid in Fort Lee, New Jersey

•

4d ago

Job Title: Quality Automation Engineer ( Mobile Apps Testing) Location: Fort Lee (Hybrid) Interview Mode: In-Person Interview Key Responsibilities:Design, develop, and maintain automated test scripts for web and mobile applicationsBuild, enhance, and maintain automation frameworks using industry-standard toolsExecute automated test suites, analyze test results, and report findingsCollaborate with developers, product managers, and QA teams to understand requirements and define test strategiesIden

Easy Apply

Full-time, Third Party

Depends on Experience

QA ENGINEER

Remote or Hybrid in New York, New York

•

4d ago

QA Analyst Finance (1 2 Years Experience)Company: AaraTech Inc About the Role AaraTech Inc is seeking a detail-oriented QA Analyst Finance to support testing of financial applications and reporting systems. This role focuses on validating functionality, data accuracy, and compliance with financial standards. You will collaborate with developers and analysts in Agile teams. Ideal for early-career QA professionals in finance systems. Key Responsibilities Execute manual test cases for financial app

Easy Apply

Contract

$60,000 - $70,000

Search all similar jobs