QA Engineer (Copilot Studio)

Job Details

Title: QA Engineer (Copilot Studio) Location: Chicago, IL Duration: but likely through end of year + extensions

Experience testing voice/chatbot and AI-driven conversations using Microsoft Copilot Studio bots
Ability to create and execute test plans/scripts for cloud-based Azure applications with Microsoft Copilot, chatbot frameworks, and AI components.
Hands on experience with Gen AI automation tools, especially Microsoft Copilot Studio Kit
Practical experience in developing, configuring, and testing bots and AI agents within the Copilot Studio environment.
Proficiency in functional, regression, integration testing
Ability to design and implement automated testing scripts and frameworks for GEN AI models
Solid understanding of Natural Language Processing (NLP) techniques and tools.
Solid understanding of Agile/Scrum practices
Strong analytical, problem-solving, and requirement analysis skills
Excellent communication and collaboration with cross-functional teams
A self-starter who can quickly adapt and deliver results
US-based and willing to travel for training/support if needed
Description:
The Copilot Studio Quality Assurance (QA) Engineer will be responsible for ensuring the quality, reliability, and functionality of conversational AI solutions built with Copilot Studio's voice capabilities.
This includes developing and executing comprehensive test plans, implement automated testing frameworks, identifying and reporting bugs, and working closely with development teams and stakeholders to ensure a seamless user experience.
The successful candidate will play a critical role in the entire software development lifecycle, from requirements gathering to deployment and post-release monitoring.