Q.A. Engineer

Job Title: Q.A. Engineer Agentforce Specialist

Location: Remote Duration: Long time

Key Responsibilities

1. AI & Agentforce Strategy

• Develop and execute comprehensive test strategies specifically for Agentforce, Data Cloud, and the Atlas Reasoning Engine .
• Design test cases for Retrieval-Augmented Generation (RAG), ensuring the agent retrieves the correct context from knowledge bases to ground its answers .
• Validate multi-turn conversationsand complex Agentic workflows (e.g., an agent updating a CRM, sending an email, and scheduling an internal task)
• Automation & Tooling
• Build and maintain automated test scripts for Agent UIand the underlying APIs using tools like Selenium, WebDriver, and JavaScript frameworks .
• Utilize Salesforce Testing Centerto create repeatable evaluation suites (Eval Suites) for utterance matching and topic routing .
• Implement custom evaluation criteria(string/numeric comparison) to validate that agent responses contain mandatory data or specific JSON structures .

4. CI/CD & DevOps

• Integrate automated agent tests into CI/CD pipelines(Jenkins/Gearset) to validate agents every time metadata (Flows, Apex, Prompt Templates) is deployed .
• Trigger Apex and Flow tests automatically to catch breaking changes in the underlying code that the agent depends on .
• Cross-functional Collaboration
• Work closely with Prompt Engineers and Developers to iterate on prompt templates and agent actions.
• Collaborate with stakeholders to define "ground truth" for agent responses in specific business scenarios.