AI Agentic Tester
Contract Corp To Corp
Contract W2
1 Year
No Travel Required
Remote
$40 - $45/hr
Galaxy i Technologies, Inc.
Fitment
Dice Job Match Score™
✨ Finding the perfect fit...
Job Details
Skills
- QA
- Gen AI
- Agentic AI
- RAG
Summary
Job Title: AI Agentic Tester
Location: Denver, CO (Zip Code: 80221)- REMOTE
Location: Denver, CO (Zip Code: 80221)- REMOTE
Role: AI Agentic Tester
Skills: QA/Test Engineering experience
Must have: Experience testing Generative AI, LLM, or AI-based applications.
Role Description: AI Agentic Tester
Essential Skills: AI Agentic Tester
Desirable Skills:
Keyword:
Skills: Modern Functional Quality Engineering
Experience Required: 2-4 Years
PFB the responsibilities and skills needed:
Functional Testing
Validate AI agent workflows against business requirements.
Test end-to-end AI use cases, including multi-agent interactions.
Verify task completion accuracy and output quality.
Test agent orchestration, tool calling, and workflow execution.
AI Model Validation
Evaluate LLM responses for accuracy, relevance, and consistency.
Test prompt engineering effectiveness and response quality.
Validate Retrieval-Augmented Generation (RAG) outputs.
Measure hallucination rates and response reliability.
Required Skills
3-8 years of QA/Test Engineering experience.
Experience testing Generative AI, LLM, or AI-based applications.
Knowledge of AI Agents, Agentic AI, RAG, and prompt engineering.
Hands-on experience with API testing (Postman, Swagger, REST APIs).
Experience with automation frameworks (Selenium, Playwright, PyTest).
Proficiency in Python.
Understanding of AI evaluation metrics and testing methodologies
Knowledge of Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms
Skills: QA/Test Engineering experience
Must have: Experience testing Generative AI, LLM, or AI-based applications.
Role Description: AI Agentic Tester
Essential Skills: AI Agentic Tester
Desirable Skills:
Keyword:
Skills: Modern Functional Quality Engineering
Experience Required: 2-4 Years
PFB the responsibilities and skills needed:
Functional Testing
Validate AI agent workflows against business requirements.
Test end-to-end AI use cases, including multi-agent interactions.
Verify task completion accuracy and output quality.
Test agent orchestration, tool calling, and workflow execution.
AI Model Validation
Evaluate LLM responses for accuracy, relevance, and consistency.
Test prompt engineering effectiveness and response quality.
Validate Retrieval-Augmented Generation (RAG) outputs.
Measure hallucination rates and response reliability.
Required Skills
3-8 years of QA/Test Engineering experience.
Experience testing Generative AI, LLM, or AI-based applications.
Knowledge of AI Agents, Agentic AI, RAG, and prompt engineering.
Hands-on experience with API testing (Postman, Swagger, REST APIs).
Experience with automation frameworks (Selenium, Playwright, PyTest).
Proficiency in Python.
Understanding of AI evaluation metrics and testing methodologies
Knowledge of Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 10374872
- Position Id: 35950-43206-1786390475
- Posted 6 hours ago
Company Info
About Galaxy i Technologies, Inc.
Galaxy i Technologies, Inc is a global consulting and IT services company that is known for its commitment to client satisfaction. Galaxy i Technologies is an information technology firm offering IT Consulting, Staff Augmentation, Software Development & Training and E-commerce Development. We help our Clients to implement these solutions through a variety of skilled consulting services like Application management, Implementation and Infrastructure management.
Galaxy i Technologies has a pool of highly skilled professionals who work through the life cycle of challenging and exciting projects, including System Analysis, Designing, Development, Implementation, Maintenance, Enhancements and Test Support to our Fortune 500 Corporations.
Careers
Galaxy i Technologies has a pool of highly skilled professionals who work through the life cycle of challenging and exciting projects, including System Analysis, Designing, Development, Implementation, Maintenance, Enhancements and Test Support to our Fortune 500 Corporations.
Careers
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs