AI Test Lead (W2 only)

Job Title: AI Test Lead 
Location: 100% Remote 
Long term contract 

NOTES: Project Overview: TechEvo Application Modernization

Job Description
•    Hands-on quality engineering lead or Senior AI Tester responsible for reverse-engineering application behavior, establishing missing system integration regression coverage, designing AI assisted test generation workflows and proving that agent driven modernization preserves functional, integration, security and operational behavior.

Required Skills - 7-10 Years of QA/SDET/QE experience with strong automation and AI testing skills.
•    Good experience with AI Assisted QE, system integration testing.
•    Strong SDET/quality engineering background with hands on automation of APIs, integrations, UI and end to end enterprise workflows.
•    Demonstrated use of AI/agentic tools to generate, refine, review, or maintain test scenarios and automation not merely general chatbot usage.
•    Experience creating regression, system integration coverage for applications with incomplete or outdated test suites.
•    Strong knowledge of test strategy, risk-based testing, test design, traceability, defect management, root-cause analysis and CI/CD quality gates.
•    Hands on experience with modern automation tools such as Playwright, Cypress, Selenium, REST/API automation, or equivalent; ability to choose tools based on architecture.
•    Working knowledge of Java/.NET application behavior, databases/SQL, APIs, middleware,
•    authentication/authorization, and enterprise integration patterns.
•    Understanding of LDAP and token-based authentication concepts sufficient to design security and role/authorization test scenarios.
•    Ability to evaluate nondeterministic AI outputs with repeatable acceptance criteria, structured evaluation, and human verification.
 
Job Requirements -
•    7-10 Years of QA/SDET/QE experience with strong automation and AI testing skills.
•    Good experience with AI Assisted QE, system integration testing.

Role Purpose:
Hands-on quality engineering lead or Senior AI Tester responsible for reverse-engineering application behavior, establishing missing system integration regression coverage, designing AI assisted test generation workflows and proving that agent driven modernization preserves functional, integration, security and operational behavior.
 
Roles and Responsibilities:
•    7-10 Years of QA/SDET/QE experience with strong automation and AI testing skills.
•    Good experience with AI Assisted QE, system integration testing.
•    Assess each application's existing test assets, business-critical flows, integrations, data dependencies, security behavior and regression risk before modernization begins.
•    Reverse-engineer system behavior with developers and AI agents, then create a risk-based system integration and regression strategy where adequate suites do not already exist.
•    Design and build executable test suites in enterprise test management/automation tooling (for example Xray-style suites), beyond developer-only unit/JUnit coverage.
•    Create, refine and govern AI agents/skills that assist with test scenario generation, test data design, coverage analysis, traceability, defect triage and regression maintenance.
•    Define test coverage for runtime/framework upgrades, dependency changes, OS/middleware changes, database/integration impacts, and LDAP-to-Okta/token-based security changes.
•    Establish quality gates for agent-generated code and modernization changes, including functional, integration, API, security, negative, compatibility, performance-smoke and deployment validation as appropriate.
•    Lead testers embedded in delivery pods, assign test work, review automation, coach AI-assisted testing practices and remain hands on for complex flows.
•    Partner with Development Leads to ensure technical specifications are testable and that acceptance criteria include measurable verification and rollback conditions.
•    Integrate automated tests into CI/CD where feasible and provide rapid, trustworthy feedback on modernization changes.
•    Drive defect root cause analysis and distinguish application defects, environment issues, test data issues, dependency incompatibility and AI agent errors.
•    Track escaped defects, automation coverage, execution reliability, agent generated test quality, rework, and regression effectiveness; use findings to improve skills/agents.

Required Skills:
•    Strong SDET/quality engineering background with hands on automation of APIs, integrations, UI and end to end enterprise workflows.
•    Demonstrated use of AI/agentic tools to generate, refine, review, or maintain test scenarios and automation not merely general chatbot usage.
•    Experience creating regression, system integration coverage for applications with incomplete or outdated test suites.
•    Strong knowledge of test strategy, risk-based testing, test design, traceability, defect management, root-cause analysis and CI/CD quality gates.
•    Hands on experience with modern automation tools such as Playwright, Cypress, Selenium, REST/API automation, or equivalent; ability to choose tools based on architecture.
•    Working knowledge of Java/.NET application behavior, databases/SQL, APIs, middleware, authentication/authorization, and enterprise integration patterns.
•    Understanding of LDAP and token-based authentication concepts sufficient to design security and role/authorization test scenarios.
•    Ability to evaluate nondeterministic AI outputs with repeatable acceptance criteria, structured evaluation, and human verification.

Preferred Skills:
•    Xray/Jira or comparable test-management tooling.
•    JUnit/TestNG and developer test frameworks, contract testing and service virtualization.
•    LLM evaluation/observability tooling and prompt/context testing.
•    Performance and resilience testing for upgraded runtime/infrastructure.
•    Regulated industry experience and audit-ready evidence/traceability.