A client of ours building in the enterprise AI space is looking to bring on a Principal QA Engineer to own quality across a multi-agent AI platform. This role will be hybrid out of Atlanta - 2-3 days onsite per week.
This is a high-impact, foundational role where you'll sit at the intersection of AI engineering, business outcomes, and quality strategy - defining what "reliable enough to ship to an executive" actually means, and building the infrastructure to enforce it.
If you're someone who thinks in business outcomes (not just test coverage), thrives in non-deterministic environments, and wants to build a QA discipline from the ground up inside a fast-moving AI company - this one's worth a conversation.
What you'll be doing -
Design and own a TDD-first QA framework built for non-deterministic AI agent outputs
Define output scoring, variance thresholds, and regression testing across model updates
Architect QA sub-agents with specialized, delegated responsibilities across the pipeline
Write BDD/Gherkin tests that business stakeholders can validate before code is written
Establish and maintain quality standards across unit, integration, and business outcome testing
Partner with engineering and product to make quality a shared, embedded discipline - not a checkpoint
What they're looking for -
- Deep, practiced understanding of TDD - not as a concept, but as a daily discipline
- Hands-on experience with AI, LLM-powered, or multi-agent applications
- Ability to articulate the difference between code correctness and business outcome validation
- Experience with BDD/Gherkin or a demonstrated ability to write tests for non-technical stakeholders
- Comfort with non-deterministic systems - variance, probabilistic outputs, and regression across model updates
- Strong communication skills - you'll work closely with both engineering and business stakeholders
Nice to have -
- Experience breaking QA into sub-agents or automated quality pipelines
- Background in fintech, enterprise SaaS, or other high-accountability output environments
- Familiarity with Playwright, Vitest, or similar tooling (methodology matters more than the stack)
The Offer
- Buckhead, Atlanta based Hybrid Schedule
- $140,000-$180,000
- Potential equity
NO SPONSORSHIP PROVIDED AT THIS TIME
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 10105282
- Position Id: 876774
- Posted 30+ days ago
Never miss an opportunity! Create an alert based on the job you applied for.
