W2 - QA Engineer with AI- Remote

Remote • Posted 1 hour ago • Updated 1 hour ago
Contract W2
6 Months
No Travel Required
Able to Sponsor
Remote
$50/hr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Artificial Intelligence
  • Amazon Web Services
  • Generative Artificial Intelligence (AI)
  • Python
  • Cloud Computing
  • Test Plans
  • Testing
  • Performance Metrics
  • Analytics
  • API
  • Customer Facing
  • Quality Assurance
  • FOCUS
  • Drupal
  • Regression Analysis

Summary

QA Engineer with AI
Duration: 5-6 months.
Number of openings:2
Location: Remote
 
JD:
About the Project:
We’re developing a new customer-facing chatbot integrated into a modern Drupal-based website. The chatbot will use GenAI and RAG (Retrieval-Augmented Generation) to provide automated FAQ-style support, with future potential for agentic automation and integration into enterprise systems. The solution will be built on AWS, primarily in Python, using frameworks like LangGraph or AWS Strands Agents.
Role Overview:
We’re seeking a hands-on QA Engineer to design and execute testing strategies for a GenAI-based, multi-agent, cloud-native chatbot platform. The focus will be on validating LLM-driven functionality, ensuring data and prompt security, and verifying integrations, performance, and reliability in AWS.
Key Responsibilities:
  1. Develop and execute test plans for chatbot logic, GenAI responses, and agent interactions.
  2. Validate RAG functionality: data retrieval accuracy, response relevance, and hallucination detection.
  3. Test API integrations between chatbot, AWS services, and enterprise systems.
  4. Implement automation for regression, performance, and cost-efficiency testing.
  5. Ensure LLM prompt security (e.g., guardrails, injection testing).
  6. Support analytics validation: user engagement, response accuracy, and model performance metrics.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91126058
  • Position Id: 8974652
  • Posted 1 hour ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote or Arkansas

Today

Easy Apply

Contract

Remote

4d ago

Easy Apply

Contract

Depends on Experience

Remote

5d ago

Easy Apply

Contract

Depends on Experience

Remote

3d ago

Easy Apply

Contract

$50 - $60

Search all similar jobs