In this role, you will architect enterprise-grade test automation frameworks, pioneer validation strategies for generative AI and agentic systems, and ensure zero-defect reliability across mission-critical healthcare workflows.
AI & Agentic Framework Validation: Design evaluation frameworks to test Retrieval-Augmented Generation (RAG) pipelines, semantic retrieval, hallucination metrics, and multi-agent workflow orchestration.
Framework Architecture: Architect scalable, maintainable UI and API test automation frameworks from scratch using Python (e.g., PyTest, Playwright, Selenium, Requests).
Healthcare Workflow Validation: Lead end-to-end testing of complex clinical and administrative workflows (e.g., EHR/EMR integrations, patient scheduling, claims routing) ensuring strict compliance with HIPAA standards.
API & UI Quality: Build automated testing suites for high-throughput RESTful/GraphQL APIs, schema contracts, microservices, and web interfaces.
Regression & CI/CD Strategy: Drive automated regression strategies integrated into CI/CD pipelines (Jenkins, GitHub Actions, GitLab CI) to ensure release velocity and reliability.
Technical Leadership: Mentor QA/automation engineers, review automation code, and champion shift-left quality practices with cross-functional teams. Requirements
Experience: 8+ years in automated software testing, framework design, and quality engineering.
Programming: Expert-level proficiency in Python for test framework design, tools, and scripting.
AI & LLM Systems: Hands-on experience or deep knowledge testing RAG architectures and Agentic frameworks (e.g., Lang Chain, Lang Graph, CrewAI, Llama Index).
Testing Mastery: Proven track record in comprehensive API testing, UI testing, and distributed regression test suites.
Domain Expertise: Solid background validating healthcare workflows, data exchange standards (HL7, FHIR), and regulatory requirements.
