Location: Remote
Contract Duration: 6 Months
Experience Required: 8–10 Years
Employment Type: Contract
Job Description
We are seeking an experienced Parloa QA Automation lead specializing in AI Voice Agents, Parloa, and IVR Testing to validate AI-powered voice agents, conversational applications, and interactive voice response systems.
The ideal candidate will have strong expertise in functional testing, test automation, end-to-end voice workflows, and AI-driven conversational applications. This role focuses on validating prompts, speech recognition, conversational responses, and integrations with CRM systems, APIs, and backend applications to ensure reliable and high-quality customer experiences.
Primary Skills
Parloa Testing
IVR Testing
Functional Testing
Test Automation
AI Voice Agent Testing
Conversational AI Testing
End-to-End Testing
Secondary Skills
Regression Testing
Integration Testing
Smoke and Sanity Testing
Prompt Validation
Intent and Entity Testing
Speech Recognition Testing
Dialog Management
API Testing
CRM Integration Testing
Backend Application Testing
JIRA
Azure DevOps
Oracle SQL
TestComplete
Multilingual and Multichannel Testing
AI Response Validation
Key Responsibilities
- Analyze business and functional requirements for AI voice agents, chatbots, IVR systems, and conversational applications.
- Design test scenarios, test cases, and test data covering positive, negative, boundary, and edge cases.
- Perform functional, integration, regression, smoke, sanity, and end-to-end testing.
- Validate conversational flows, prompts, intents, entities, dialog management, and expected AI responses.
- Test end-to-end voice workflows to ensure accurate execution and successful business process completion.
- Evaluate speech recognition accuracy, response quality, and conversational behavior, including dynamic AI-generated responses.
- Validate multilingual and multichannel customer interactions across supported platforms.
- Develop and maintain automated test scripts and frameworks for repeatable conversational workflows.
- Identify opportunities to automate repetitive voice-agent and prompt-based testing activities.
- Test integrations with CRM platforms, APIs, backend systems, and third-party services.
- Log, track, investigate, and retest defects using JIRA, Azure DevOps, or equivalent tools.
- Collaborate with Business Analysts, Developers, AI Engineers, and Product Owners to resolve defects and improve quality.
- Validate business, security, and accessibility requirements as applicable.
- Prepare test execution reports and provide release readiness assessments.
- Support User Acceptance Testing (UAT) and production validation activities.
Required Qualifications
- 8–10 years of experience in Quality Assurance, software testing, and functional testing.
- Hands-on experience with Parloa and/or IVR testing.
- Strong understanding of AI voice agents, chatbots, conversational agents, and voice-based applications.
- Experience testing conversational workflows, prompts, intents, entities, and dialog management.
- Experience with functional, integration, regression, smoke, sanity, and end-to-end testing.
- Practical experience with test automation tools, frameworks, and automated test script development.
- Ability to validate dynamic and non-deterministic AI-generated responses.
- Experience testing speech recognition, voice interaction workflows, and conversational response quality.
- Knowledge of API integrations, CRM systems, backend applications, and third-party services.
- Experience with defect tracking and test management tools such as JIRA or Azure DevOps.
- Strong analytical, troubleshooting, and problem-solving skills.
Preferred Qualifications
- Experience with AI agents and digital conversational platforms.
- Knowledge of Oracle SQL for data validation and backend testing.
- Experience with TestComplete or similar automation tools.
- Exposure to performance, ERP, and CRM testing.
- Experience validating multilingual and multichannel customer interactions.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, and gender identity), national origin, age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable federal, state, or local law.
We are committed to providing reasonable accommodations to qualified applicants with disabilities and for sincerely held religious beliefs, as required by applicable law. Applicants who require a reasonable accommodation during the hiring process may request assistance.
Employment may be contingent upon the successful completion of job-related pre-employment screening, which may include background and reference checks and, where permitted by applicable law and applicable to the position, drug testing. All such screening will be conducted in accordance with applicable federal, state, and local laws.
