Position: Quality Engineer – AI & Test Automation
Duration: Long Term
Location: Atlanta or San Francisco (Preferred)
Remote: Candidates can work remotely but must work in the PST time zone.
Skill Matrix to be filled by Candidates
Skill | Years of Experience | Year Last Used |
AI Testing | | |
GenAI / LLM | | |
AI-Assisted Test Automation | | |
Selenium | | |
Playwright | | |
Cypress | | |
API Testing (REST) | | |
Python / Java | | |
CI/CD (Jenkins/Azure DevOps/GitHub Actions) | | |
Test Automation Framework Development | | |
Test Case Generation using AI | | |
Defect Analysis using AI | | |
Role Summary
The AI Automation Quality Engineer is responsible for developing intelligent and scalable test automation solutions using AI/GenAI, modern automation frameworks, and engineering practices to improve software quality, test coverage, and delivery speed.
This is a hands-on Quality Engineering and automation development role, not a primarily manual QA/testing position.
Key Responsibilities
· Develop and maintain automated testing frameworks for UI, API, integration, regression, and end-to-end testing.
· Build AI-assisted test automation using GenAI tools to generate test cases, test data, automation scripts, and validation scenarios.
· Use AI to identify test coverage gaps, regression risks, defects, and potential failure scenarios.
· Automate API testing for REST/SOAP services and validate integrations across enterprise applications.
· Develop automated regression suites and integrate them into CI/CD pipelines.
· Use AI to accelerate test-script generation, test maintenance, defect analysis, root-cause analysis, and test documentation.
· Analyze test results, application logs, API responses, and observability data to identify root causes and troubleshoot complex issues.
· Integrate automation with tools such as GitHub Actions, Azure DevOps, Jenkins, Datadog, and other CI/CD or observability platforms.
· Participate in story refinement and design discussions to identify acceptance-criteria gaps, testability concerns, dependencies, and test scenarios before development begins.
· Work closely with developers to implement shift-left testing and build automation within the sprint.
· Design reusable automation components and maintainable test frameworks.
· Develop and manage test data required for automated testing.
· Provide automated quality metrics and test results to support release-readiness decisions.
Pega Testing Experience
Experience with Pega application testing is highly preferred, including:
· Pega case-management and workflow testing
· Pega Constellation UI
· Case Types, Stages, Assignments, SLAs and business rules
· Role/persona-based workflow validation
· Pega REST/API integrations
· End-to-end testing across Pega and downstream enterprise applications
· PegaUnit or other Pega testing capabilities
AI / GenAI Quality Engineering
Experience or working knowledge of:
· AI-assisted test-case generation
· AI-assisted automation-code generation with github copilot
· Automated test-data generation
· AI-assisted identification of test-coverage gaps
· AI-assisted defect/root-cause analysis
· Using GenAI development tools to improve QE productivity
· Testing AI/GenAI-enabled application capabilities
· Understanding the challenges of validating non-deterministic AI-generated outputs
Must-Have Technical Skills
Programming & Automation
· Java
· Object-Oriented Programming
· Selenium WebDriver/Karate
· TestNG / JUnit
· Page Object Model (POM)
· XPath / CSS Selectors
· Data-driven, Hybrid and BDD automation frameworks
· Gherkin
· Maven or Gradle
API & Integration Testing
· REST Assured
· Postman
· SOAP UI
· REST / SOAP
· JSON / XML
· HTTP methods, status codes, headers, authentication and error handling
Database
· SQL
· Backend/database validation
· SQL Developer or equivalent database tools
Source Control & CI/CD
· Git / GitHub
· GitHub Actions
· Jenkins and/or Azure DevOps
· Ability to create and maintain automated test jobs/pipelines
Preferred Technical Skills
· Playwright/Selenium/Karate
· Groovy
· YAML
· VS code
· JDK 8/17/21
· Sauce Labs or equivalent cross-browser/cloud testing platform
· Allure / Extent Reports / ReportNG
· Log4j / SLF4J
· JIRA
· AWS or Azure
· Observability platforms such as Datadog
· Performance and accessibility testing
Framework / Design Knowledge
Strong understanding of automation design patterns and reusable framework development, including:
· Page Object Model
· Data-driven frameworks
· Hybrid frameworks
· BDD
· Reusable automation components
· Appropriate software design patterns for automation frameworks
Preferred Domain Experience
· Pega-based enterprise applications
· Healthcare, dental, insurance, claims, clinical, enrollment, provider, or contact-center applications
· Java/Spring Boot APIs and microservices
· Large-scale enterprise modernization programs
Alchemy: Transforming Your Professional Vision into Reality
Since our inception in 2013, Alchemy has been dedicated to reshaping organizational performance through innovative IT services. With a vision to empower businesses seeking a transformative edge, we’ve positioned ourselves at the forefront of digitization and software modernization.
Our name reflects our mission: to transmute technology into gold-standard solutions for our esteemed clients. We proudly serve a diverse range of sectors, including IT and ITES, BFSI, Telecom and Media, Automotive, Manufacturing, Energy, Oil and Gas, Real Estate, Retail, Healthcare, and more.
With a global footprint spanning the USA, India, Europe, Canada, Singapore, Japan, and parts of Central and West Africa, we harness a unique blend of competencies, frameworks, and cutting-edge technologies. Together, we drive growth and innovation across industries, helping organizations turn their visions into reality.
Alchemy – Connecting Talent with Opportunities (Diversity, Equity and Inclusion)
Never miss an opportunity! Create an alert based on the job you applied for.
