AI / ML Architect/Developer/Tester ( 3 roles) – GenAI (LLM & RAG)

AI / ML Architect – GenAI (LLM & RAG)

Location: Philadelphia, PA (Hybrid – onsite PI meetings once a month / quarter)
Duration: 6+ Months Contract

AWS SageMaker, Bedrock, S3 · Python · LLMs · RAG · Vector DB (OpenSearch/DynamoDB)

Role Focus:

• Test LLM & RAG pipelines (prompt accuracy, grounding, hallucination checks)
• Validate ML models (data, features, inference, drift)
• Test AWS ML workflows (training, endpoints, pipelines)
• Ensure governance, auditability, and compliance readiness

Must-Have:

• 4+ yrs QA/testing (data, ML, or AI systems)
• Hands-on testing of LLM/GenAI applications
• Python for test automation & data validation
• Understanding of model behavior & evaluation metrics

Nice-to-Have:

• Regulated domains (Insurance / BFS)