Agentic AI Engineering Manager

Role : Agentic AI Engineering Manager

Duration : Long Term Contact

Location : New York Hybrid

Job Description: Overview of Position:**The QA Engineering Manager will lead User Acceptance Testing (UAT) and Quality Engineering for large, complex initiatives within an Agile environment for the Agency Team. This role is AIfirst by design, with a core mandate to evolve testing from manual and script-based automation into agentic, autonomous quality systems.

The successful candidate will architect and scale LLMpowered testing agents that transform intake forms, requirements, and user journeys into executable test assets integrated into CI/CD pipelines and governed through robust risk and controls frameworks. This role will partner closely with product, engineering, design, and marketing teams to ensure exceptional customer experiences at scale.
Job Responsibilities -
Agentic QA & Test Automation Leadership
Design and implement agentbased QA systems that autonomously generate, execute, and maintain automated test scripts using inputs such as intake forms, user stories, and acceptance criteria.
Lead the transition from traditional test automation to AIassisted and agentic testing models, including selfhealing tests, adaptive coverage, and intelligent test prioritization.
Define the testing agent architecture (roles, handoffs, guardrails, humanintheloop controls).
Automation & CI/CD Integration
Direct development of automated test frameworks for web, mobile, and APIbased applications.
Partner with engineering teams to integrate AIgenerated and agentdriven tests into CI/CD pipelines.
Establish telemetry, metrics, and feedback loops so agents continuously improve test quality and coverage.
Strategy, Collaboration & Delivery
Collaborate with senior leaders and product/program teams to define endtoend test strategies tied to customer journeys and business outcomes.
Translate business requirements into structured inputs optimized for autonomous test generation.
Create, manage, and communicate prioritization of features, balancing user experience, business impact, and testing risk.
Coordinate across crossfunctional teams to align requirements, dependencies, and delivery timelines.
Governance, Risk & Continuous Improvement
Ensure all AIdriven testing approaches comply with enterprise risk, control, and audit requirements.
Establish guardrails, validation checkpoints, and escalation paths for agentgenerated outputs.
Conduct root cause analysis on defects, test gaps, and automation failures feeding insights back into agent behavior and system design.
Drive continuous improvement in testing efficiency, effectiveness, and reliability.
Agentic AI & Advanced Automation Capabilities
Experience using LLMs or AI systems to generate test cases, test scripts, or QA artifacts.
Ability to transform structured and semistructured inputs (intake forms, user stories, journeys) into executable automation assets.
Understanding of agentic patterns such as:
Multiagent collaboration
Toolusing agents
Humanintheloop validation
Selfhealing or adaptive automation
Ability to evaluate, select, and integrate AI tooling responsibly within enterprise constraints.
Required Qualifications, Capabilities, And Skills
Bachelor s degree in a relevant field (e.g., Computer Science, Engineering, Business).
5 to 10 years of experience in managing testing efforts within a large-scale Agile environment, particularly in financial services.
Proven experience in developing and executing automated test cases for web and mobile applications used in marketing.
Understanding of marketing and martech platforms
Strong understanding of Agile methodologies and testing techniques.
Proficiency in tools such as Workfront Jira, Visio, PowerPoint, and Excel.
Familiarity with development languages (e.g., Java, Python) and test automation tools.
Comprehensive understanding of risk and controls, audit requirements, and the ability to work effectively with diverse stakeholders across the organization.