QA Engineer AI Product Testing (Prompt Engineering, API & Security Scenarios)

We are seeking a meticulous QA Engineer with hands-on experience in testing AI-driven platforms to join our dynamic team. This role focuses on validating generative AI models (like Gemini, PaLM), API integrations, data security, and user experience across web-based AI studio environments.

You ll play a critical role in ensuring functional reliability, ethical compliance, and top-tier performance across AI workflows including prompt/response behaviors, API validation, and UI responsiveness.

---

Key Responsibilities
1. Functional Testing

• Validate core AI functionalities including model loading, prompt input/output, and token calculation.
• Test model switching, fine-tuning, and prompt template saving features.
• Verify integrations with tools like Google Sheets, Docs, and BigQuery.

2. Prompt/Response Validation

• Test AI responses for clarity, creativity, context retention, summarization, and data extraction.
• Validate ethical response behavior and proper citation when applicable.

3. Security & Privacy Assurance

• Verify that no sensitive user data is retained or leaked.
• Validate RBAC controls, prompt history access, and secure integration with Google Cloud Identity/IAM.

4. API & Developer Scenario Testing

• Ensure REST/gRPC APIs return accurate responses, handle malformed requests, and follow authentication/authorization flows.
• Test rate limiting, throttling, and latency SLAs.

5. Error Handling

• Validate system responses to invalid or oversized inputs, model unavailability, and try again workflows.
• Test user feedback mechanisms like thumbs up/down.

6. Performance & Load

• Conduct load tests (100+ sessions), stress tests, and performance validation across browsers/devices.
• Ensure prompt response within <2 seconds under normal load.

7. UI/UX & Accessibility Testing

• Validate prompt rendering, syntax highlighting, mobile responsiveness, dark/light mode, and WCAG compliance.

8. AI-Specific Ethical Testing

• Test model safeguards against offensive, unsafe, or unethical prompts.
• Ensure AI-generated content includes appropriate disclaimers and bias mitigation.

---

Skills & Requirements

• 5+ years in QA Testing, preferably in AI/ML product environments.
• Experience with API tools (Postman, Swagger, REST/gRPC testing).
• Familiarity with LLM-based platforms like Gemini, Bard, PaLM, or GPT.
• Experience with performance testing tools (e.g., JMeter, Locust).
• Knowledge of security protocols (RBAC, OAuth, IAM) and compliance standards.
• Strong understanding of ethical AI principles.
• Excellent analytical, documentation, and debugging skills.

---

Bonus Points

• Experience working with AI/ML prompt engineering or fine-tuning.
• Prior QA testing in SaaS or Cloud platforms (Google Cloud Platform/AWS preferred).
• Exposure to CI/CD pipelines and automated testing frameworks.