Job Title: Quality Engineer – AI & Test Automation
Location: Remote
Duration: Long-term
Role Summary
The AI Automation Quality Engineer is responsible for developing intelligent and scalable test automation solutions using AI/GenAI, modern automation frameworks, and engineering practices to improve software quality, test coverage, and delivery speed.
This is a hands-on Quality Engineering and automation development role, not a primarily manual QA/testing position.
Key Responsibilities
- Develop and maintain automated testing frameworks for UI, API, integration, regression, and end-to-end testing.
- Build AI-assisted test automation using GenAI tools to generate test cases, test data, automation scripts, and validation scenarios.
- Use AI to identify test coverage gaps, regression risks, defects, and potential failure scenarios.
- Automate API testing for REST/SOAP services and validate integrations across enterprise applications.
- Develop automated regression suites and integrate them into CI/CD pipelines.
- Use AI to accelerate test-script generation, test maintenance, defect analysis, root-cause analysis, and test documentation.
- Analyze test results, application logs, API responses, and observability data to identify root causes and troubleshoot complex issues.
- Integrate automation with tools such as GitHub Actions, Azure DevOps, Jenkins, Datadog, and other CI/CD or observability platforms.
- Participate in story refinement and design discussions to identify acceptance-criteria gaps, testability concerns, dependencies, and test scenarios before development begins.
- Work closely with developers to implement shift-left testing and build automation within the sprint.
- Design reusable automation components and maintainable test frameworks.
- Develop and manage test data required for automated testing.
- Provide automated quality metrics and test results to support release-readiness decisions.
Pega Testing Experience
Experience with Pega application testing is highly preferred, including:
- Pega case-management and workflow testing
- Pega Constellation UI
- Case Types, Stages, Assignments, SLAs and business rules
- Role/persona-based workflow validation
- Pega REST/API integrations
- End-to-end testing across Pega and downstream enterprise applications
- PegaUnit or other Pega testing capabilities
AI / GenAI Quality Engineering
Experience or working knowledge of:
- AI-assisted test-case generation
- AI-assisted automation-code generation with github copilot
- Automated test-data generation
- AI-assisted identification of test-coverage gaps
- AI-assisted defect/root-cause analysis
- Using GenAI development tools to improve QE productivity
- Testing AI/GenAI-enabled application capabilities
- Understanding the challenges of validating non-deterministic AI-generated outputs
Must-Have Technical Skills
Programming & Automation
- Java
- Object-Oriented Programming
- Selenium WebDriver/Karate
- TestNG / JUnit
- Page Object Model (POM)
- XPath / CSS Selectors
- Data-driven, Hybrid and BDD automation frameworks
- Gherkin
- Maven or Gradle
API & Integration Testing
- REST Assured
- Postman
- SOAP UI
- REST / SOAP
- JSON / XML
- HTTP methods, status codes, headers, authentication and error handling
Database
- SQL
- Backend/database validation
- SQL Developer or equivalent database tools
Source Control & CI/CD
- Git / GitHub
- GitHub Actions
- Jenkins and/or Azure DevOps
- Ability to create and maintain automated test jobs/pipelines
Preferred Technical Skills
- Playwright/Selenium/Karate
- Groovy
- YAML
- VS code
- JDK 8/17/21
- Sauce Labs or equivalent cross-browser/cloud testing platform
- Allure / Extent Reports / ReportNG
- Log4j / SLF4J
- JIRA
- AWS or Azure
- Observability platforms such as Datadog
- Performance and accessibility testing
Framework / Design Knowledge
Strong understanding of automation design patterns and reusable framework development, including:
- Page Object Model
- Data-driven frameworks
- Hybrid frameworks
- BDD
- Reusable automation components
- Appropriate software design patterns for automation frameworks
Preferred Domain Experience
- Pega-based enterprise applications
- Healthcare, dental, insurance, claims, clinical, enrollment, provider, or contact-center applications
- Java/Spring Boot APIs and microservices
- Large-scale enterprise modernization programs
Never miss an opportunity! Create an alert based on the job you applied for.
