AI Test Lead 100% Remote
Job Description
Hands-on quality engineering lead or Senior AI Tester responsible for reverse-engineering application behavior, establishing missing system integration regression coverage, designing AI assisted test generation workflows and proving that agent driven modernization preserves functional, integration, security and operational behavior.
Required Skills - 7-10 Years of QA/SDET/QE experience with strong automation and AI testing skills.
• Good experience with AI Assisted QE, system integration testing.
Strong SDET/quality engineering background with hands on automation of APIs, integrations, UI and end to end enterprise workflows.
• Demonstrated use of AI/agentic tools to generate, refine, review, or maintain test scenarios and automation not merely general chatbot usage.
• Experience creating regression, system integration coverage for applications with incomplete or outdated test suites.
• Strong knowledge of test strategy, risk-based testing, test design, traceability, defect management, root-cause analysis and CI/CD quality gates.
• Hands on experience with modern automation tools such as Playwright, Cypress, Selenium, REST/API automation, or equivalent; ability to choose tools based on architecture.
• Working knowledge of Java/.NET application behavior, databases/SQL, APIs, middleware,
authentication/authorization, and enterprise integration patterns.
• Understanding of LDAP and token-based authentication concepts sufficient to design security and role/authorization test scenarios.
• Ability to evaluate nondeterministic AI outputs with repeatable acceptance criteria, structured evaluation, and human verification.
Job Duties -
Assess each application's existing test assets, business-critical flows, integrations, data
dependencies, security behavior and regression risk before modernization begins.
• Reverse-engineer system behavior with developers and AI agents, then create a risk-based system
integration and regression strategy where adequate suites do not already exist.
• Design and build executable test suites in enterprise test management/automation tooling (for
example Xray-style suites), beyond developer-only unit/JUnit coverage.
• Create, refine and govern AI agents/skills that assist with test scenario generation, test data design,
coverage analysis, traceability, defect triage and regression maintenance.
• Define test coverage for runtime/framework upgrades, dependency changes, OS/middleware
changes, database/integration impacts, and LDAP-to-Okta/token-based security changes.
• Establish quality gates for agent-generated code and modernization changes, including functional,
integration, API, security, negative, compatibility, performance-smoke and deployment validation
as appropriate.
• Lead testers embedded in delivery pods, assign test work, review automation, coach AI-assisted
testing practices and remain hands on for complex flows.
• Partner with Development Leads to ensure technical specifications are testable and that
acceptance criteria include measurable verification and rollback conditions.
• Integrate automated tests into CI/CD where feasible and provide rapid, trustworthy feedback on
modernization changes.
• Drive defect root cause analysis and distinguish application defects, environment issues, test data
issues, dependency incompatibility and AI agent errors.
• Track escaped defects, automation coverage, execution reliability, agent generated test quality,
rework, and regression effectiveness; use findings to improve skills/agents.
Job Requirements -
7-10 Years of QA/SDET/QE experience with strong automation and AI testing skills.
• Good experience with AI Assisted QE, system integration testing.
Role Purpose:
Hands-on quality engineering lead or Senior AI Tester responsible for reverse-engineering application
behavior, establishing missing system integration regression coverage, designing AI assisted test
generation workflows and proving that agent driven modernization preserves functional, integration,
security and operational behavior.
Roles and Responsibilities:
• 7-10 Years of QA/SDET/QE experience with strong automation and AI testing skills.
• Good experience with AI Assisted QE, system integration testing.
• Assess each application's existing test assets, business-critical flows, integrations, data
dependencies, security behavior and regression risk before modernization begins.
• Reverse-engineer system behavior with developers and AI agents, then create a risk-based system
integration and regression strategy where adequate suites do not already exist.
• Design and build executable test suites in enterprise test management/automation tooling (for
example Xray-style suites), beyond developer-only unit/JUnit coverage.
• Create, refine and govern AI agents/skills that assist with test scenario generation, test data design,
coverage analysis, traceability, defect triage and regression maintenance.
• Define test coverage for runtime/framework upgrades, dependency changes, OS/middleware
changes, database/integration impacts, and LDAP-to-Okta/token-based security changes.
• Establish quality gates for agent-generated code and modernization changes, including functional,
integration, API, security, negative, compatibility, performance-smoke and deployment validation
as appropriate.
• Lead testers embedded in delivery pods, assign test work, review automation, coach AI-assisted
testing practices and remain hands on for complex flows.
• Partner with Development Leads to ensure technical specifications are testable and that
acceptance criteria include measurable verification and rollback conditions.
• Integrate automated tests into CI/CD where feasible and provide rapid, trustworthy feedback on
modernization changes.
• Drive defect root cause analysis and distinguish application defects, environment issues, test data
issues, dependency incompatibility and AI agent errors.
• Track escaped defects, automation coverage, execution reliability, agent generated test quality,
rework, and regression effectiveness; use findings to improve skills/agents.
Required Skills:
• Strong SDET/quality engineering background with hands on automation of APIs, integrations, UI
and end to end enterprise workflows.
• Demonstrated use of AI/agentic tools to generate, refine, review, or maintain test scenarios and
automation not merely general chatbot usage.
• Experience creating regression, system integration coverage for applications with incomplete or
outdated test suites.
• Strong knowledge of test strategy, risk-based testing, test design, traceability, defect management,
root-cause analysis and CI/CD quality gates.
• Hands on experience with modern automation tools such as Playwright, Cypress, Selenium,
REST/API automation, or equivalent; ability to choose tools based on architecture.
• Working knowledge of Java/.NET application behavior, databases/SQL, APIs, middleware,
authentication/authorization, and enterprise integration patterns.
• Understanding of LDAP and token-based authentication concepts sufficient to design security and
role/authorization test scenarios.
• Ability to evaluate nondeterministic AI outputs with repeatable acceptance criteria, structured
evaluation, and human verification.
Preferred Skills:
• Xray/Jira or comparable test-management tooling.
• JUnit/TestNG and developer test frameworks, contract testing and service virtualization.
• LLM evaluation/observability tooling and prompt/context testing.
• Performance and resilience testing for upgraded runtime/infrastructure.
• Regulated industry experience and audit-ready evidence/traceability.
Desired Skills & Experience - • Xray/Jira or comparable test-management tooling.
• JUnit/TestNG and developer test frameworks, contract testing and service virtualization.
• LLM evaluation/observability tooling and prompt/context testing.
• Performance and resilience testing for upgraded runtime/infrastructure.
• Regulated industry experience and audit-ready evidence/traceability.
Never miss an opportunity! Create an alert based on the job you applied for.
