Remote -EST/CST
Exp: 15+yrs
Need to come to chicago for day 1 to pick up laptop
3-5 Must Haves (need to be highlighted in sizzle & present on resume)
- Platform Engineering experience building internal platforms, automation platforms, developer tooling, or cloud-native solutions.
- Strong TypeScript/Node.js and/or Python engineering experience.
- Cloud & CI/CD Engineering experience, including hands-on AWS and Infrastructure as Code (Terraform preferred).
- AI / LLM Integration experience, including building AI-powered systems that interact with external tools, APIs, repositories, or enterprise platforms through multi-step workflows.
Job Description
We are seeking a Senior AI QA Platform Engineer to design and implement an enterprise AI-enabled QA Orchestration Platform leveraging Amazon Bedrock, AgentCore, Playwright, AWS CodeBuild, GitHub, Databricks, Jira, and qTest. This platform will utilize agentic AI workflows to generate and maintain automated tests, orchestrate execution paths, classify test failures, create actionable defects, and provide governance, observability, traceability, and auditability across the QA lifecycle. The ideal candidate will combine expertise in software engineering, cloud-native platforms, AI/LLM integration, CI/CD automation, and quality engineering to help establish a next-generation AI-powered testing ecosystem.
Primary Responsibilities
• Design and implement AI-powered QA orchestration workflows using Amazon Bedrock and AgentCore.
• Develop agent-based automation capabilities for: - Test generation - Test maintenance - Failure classification - Defect routing - Test intelligence and analytics
• Integrate AI workflows with Playwright automation frameworks and repository-aware test generation patterns.
• Build automated GitHub branch creation, pull request generation, and repository management capabilities.
• Design and implement integrations with AWS CodeBuild and enterprise CI/CD pipelines.
• Develop rule-based quality gates and AI-assisted failure analysis workflows.
• Build integrations with Databricks, Jira, qTest, and GitHub.
• Leverage Databricks TDM and analytics to provide historical context and intelligent failure classification.
• Design and implement AI governance controls including: - Prompt version control - Approved action policies - Audit logging - Human-in-the-loop workflows - AI action traceability
• Develop observability, monitoring, and operational reporting capabilities. • Collaborate with QA, DevOps, Cloud Engineering, Data Engineering, and Security teams to establish enterprise AI testing standards and platform architecture.
Required Technical Skills AI & Agentic Systems:
Claude, Prompt Engineering, Agentic AI Workflows, Multi-Agent Architectures, MCP (Model Context Protocol)
Preferred Agent Framework Experience:
Strands Agents, Amazon Bedrock, AgentCore
Programming: TypeScript, Node.js, JavaScript, SQL, REST API Development
Cloud & AWS: AWS, IAM, CodeBuild, CloudWatch, S3, Secrets Manager, Parameter Store
DevOps & CI/CD: GitHub, GitHub Actions, CI/CD Pipelines, Infrastructure as Code (Terraform preferred)
Automation: Playwright, API Testing, Test Automation Framework Architecture, Test Data Management Concepts
Enterprise Platforms: Jira, qTest, Databricks
Preferred Qualifications
• Bachelor''s degree in Computer Science, Engineering, Information Systems, or equivalent experience.
• 7+ years of software engineering, automation engineering, platform engineering, or cloud engineering experience.
• 5+ years designing and implementing enterprise test automation solutions.
• Experience building cloud-native solutions on AWS.
• Experience integrating AI/LLM capabilities into engineering or automation platforms.
• Experience developing CI/CD pipelines, automation frameworks, and developer platforms.
• Experience designing governance, auditability, compliance, and operational controls.
• Experience with Databricks, Test Data Management (TDM), or analytics-driven automation solutions.
• Experience implementing Infrastructure as Code using Terraform.
Preferred Certifications AWS Certified Solutions Architect AWS Certified AI Practitioner HashiCorp Terraform Associate AWS Certified Developer – Associate
Never miss an opportunity! Create an alert based on the job you applied for.
