Senior QA Automation Engineer

Title: Senior QA Automation Engineer
Location: 100% Remote
Duration: Long Term

About the Opportunity

As a Senior QA Automation Engineer for the Create domain, you provide QA leadership for the platform that powers test content authoring across SAT, AP, and other College Board assessment products. You own application quality and release readiness for these authoring tools — ensuring features are thoroughly tested, defects are identified and resolved, and each release meets agreed quality standards before reaching the content authors, reviewers, and program teams who depend on them. You apply advanced testing strategies, scalable automation frameworks, and deep QA best practices to a modern, AWS-based platform that integrates with a range of upstream and downstream assessment systems.

Leveraging your strong analytical and problem-solving skills, you will analyze complex feature requirements, automate testing processes, and drive efficiencies. Collaborating with cross-functional teams across engineering, product, design, and assessment content, you will contribute to improving the reliability and efficiency of the tools that shape the questions students see on test day. This role is ideal for someone who thrives in a fast-paced environment and is eager to make a meaningful impact on critical organizational priorities.

In this role, you will:

·       Own application quality and release readiness for the Create domain, ensuring features meet agreed quality standards before deployment to content authors and program teams.

·       Design, develop, and maintain comprehensive test plans, test cases, and scalable automated test suites across back-end services, front-end applications, and supporting infrastructure.

·       Design and implement automated testing frameworks for content authoring tools and the workflows that move items and assessments through review, approval, and publication.

·       Write modular, maintainable, refactor-safe test suites with the same rigor as application code.

·        Integrate automated testing into CI/CD pipelines and maintain them as a core part of the delivery process.

·       Conduct functional, regression, and security testing; partner with platform and performance engineers on load and performance testing as needed.

·       Collaborate with product managers, designers, and developers to review requirements, ensure testability, and translate business needs into comprehensive test scenarios.

·       Lead defect analysis and drive systemic quality improvements; define quality metrics and observability practices.

·       Champion adherence to Accessibility Compliance Office guidance, engineering best practices, and accessibility standards across the team’s deliverables.

·       Mentor engineers on left-shifting testing, shared responsibility for quality and reliability, and active consideration of product and user requirements.

·       Act as a subject-matter expert for the engineering team on leveraging Claude Code to improve, scale, and ensure the quality of AI-generated tests and supporting code.

·       Identify, recommend, and implement tools and practices that enhance testing efficiency.

·       Support production issue resolution by troubleshooting and partnering with engineering teams to implement fixes.

About you, you have:

·       Bachelor’s degree in Computer Science, Computer Engineering, Software Engineering, or an analytical field (or equivalent experience).

·       7+ years of professional experience in software quality assurance, test automation, or quality engineering.

·       Strong expertise in test automation frameworks and hands-on experience building scalable automated test suites.

·       Proficiency with TypeScript, Node.js, and Playwright.

·       Comfortable testing systems built on AWS (Lambda, S3, DynamoDB, CloudWatch); exposure to event-driven services like Step Functions / SNS / SQS a plus.

·       Experience integrating automated testing into CI/CD pipelines.

·       Experience creating QA strategy, identifying comprehensive test scenarios from business requirements, and building complex test data that covers edge cases.

·       Experience owning features across the full software lifecycle and influencing system design and technical decisions across multiple teams.

·       Experience participating in code review and giving feedback on both application and test PRs.

·       Comfortable reading application source code to design targeted tests rather than relying solely on UI/black-box coverage.

·       Experience

·       Strong understanding of Agile methodology and willingness to work in a DevOps environment.

·       A natural curiosity about the product — the kind of engineer who actively builds an understanding of business needs and find bugs before product or end users do.

·       Sharp prioritization instincts: ability to weigh downstream impact, scale, and risk when deciding which quality issues to focus on.

·       Excellent communication and collaboration skills across technical and business teams; able to mentor peers and work effectively with a diverse set of colleagues.

·       Proactive, with a strong sense of ownership; comfortable analyzing, planning, and owning vaguely defined problems with little supervision.

Additional nice-to-have qualifications:

·       Experience applying AI-driven test automation or predictive analytics for defect detection.

·       Experience using Claude Code or similar AI coding tools in a production engineering workflow.

·       Performance testing experience.