Sr QA Engineer for GenAI Product Team

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr QA Engineer for a contract assignment with one of our premier Management Consulting clients. This role will be remote (preferably EST located).and candidates must have excellent communication skills to go along with a hands-on QA Engineering background (including writing automated test scripts) and will be working on various technical elements for a team supporting a GenAI platform/product used by clients for ontology and relationship mapping and associated analytics/insights. Experience is required in the following: API Testing, some experience with AI prompt engineering and data element testing (database, data engineering, ingestion pipelines, etc), AI agentic testing, and ability to work as part of a 4-5 person Agile testing team. Should have a technical background in: Neo4J, Vector Databases (Pinecone, Milvus or anything similar), Python/PyTorch, Docker/Kubernetes, GraphQL (or similar).

Responsibilities :

• Define and drive the quality strategy for complex services, designing test approaches that cover data, services, and UI.
• Build robust automation in Python, establish quality gates in CI/CD, and partner closely with engineers and data scientists to catch defects early and measure real-world reliability and safety.
• Turn observability and evaluation signals into actionable improvements that accelerate safe, high-confidence releases.
• Develop and execute test plans, test cases, and test scripts to ensure software meets quality standards,
• Perform functional, regression, performance, and usability testing to identify and report defects,
• Collaborate with cross-functional teams to understand project requirements and ensure testing aligns with project objectives,
• Document and track defects, and work closely with developers to resolve issues,
• Conduct root cause analysis to identify underlying issues and suggest process improvements,
• Maintain test environments and test data for accurate and reliable testing,
• Stay up-to-date with industry trends and best practices in software testing methodologies and tools.

Required Skills:

• 5-8+ years in QA/SDET roles testing backend services, data-intensive systems, and web applications in fast-moving environments
• Previous experience with enterprise platforms
• Strong Python skills (pytest/unittest, fixtures, mocking); able to author maintainable test suites, utilities, and lightweight harnesses
• Automated API testing expertise (REST/GraphQL), including schema/contract testing (OpenAPI/AsyncAPI, Pact), negative tests, and auth/SSO flows (OAuth/OIDC)
• Web UI automation experience (Cypress), with a pragmatic approach to the test pyramid and flake-reduction techniques
• Data and model-centric testing: data quality validation (Great Expectations/Pandera), experiment reproducibility, golden datasets, drift/robustness checks, and offline vs. online evaluation strategies
• Familiarity with evaluation of LLM-powered features (prompt robustness, deterministic scaffolding, guardrail checks, safety/quality metrics), plus RAG/search-quality testing where applicable
• Performance and reliability testing (load, soak, latency, scalability) using tools such as Locust, k6, or JMeter; capacity to interpret results and drive remediation with engineering
• CI/CD quality gates (GitHub Actions/GitLab/Jenkins), test impact analysis, parallelization, and quarantine strategies for flaky tests
• Observability-driven quality: logs/metrics/traces (OpenTelemetry, PrometheGrafana), synthetic monitoring, canary/shadow testing, and SLO/SLA alignment
• Containers and orchestration (Docker/Kubernetes) and cloud fluency (AWS/Azure/Google Cloud Platform), including ephemeral test environments and secrets management
• Database and messaging fundamentals (SQL, schema evolution, migrations; Kafka/Pub/Sub) and comfort validating data pipelines end-to-end
• Security/privacy awareness across testing (PII handling, least-privilege, secrets, vulnerability scanning) and collaboration with security and compliance partners
• Excellent communication-clear defect narratives, crisp risk/mitigation framing, and the ability to translate findings for engineers, product managers, and non-technical stakeholders
• Education: Degree in CS/Engineering or equivalent experience
• Location - Location is flexible, but ET time zone preferred. Some travel may be required

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy