Overview
On Site
$50 - $55
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
Skills
IVR testing
CYARA
Job Details
Role: IVR testing- CYARA talent
Location: Irving, TX (or) Plano,TX
Experience in IVR testing
CYARA tool exp is mandate.
Basic Knowledge of how LLMs process information, their strengths (e.g., summarization, text generation, translation) and limitations (e.g., hallucinations, biases, factual inaccuracies, lack of real-time knowledge)
Expertise on AI Testing Techniques (Zero-shot prompting, Few-shot prompting, Chain of Thought, Feedback Loop, Tree-of-Thought)
Expertise NLP Concepts (tokenization, sentiment analysis, text summarization)
Ability to analyze how context, tone, length, and specific instructions in a prompt influence the AI's output.
Troubleshoot unexpected responses and optimize for specific metrics.
Critical & Analytical Thinking to generate AI Bot Test cases.
Ability to create comprehensive and diverse test cases specifically for prompts, covering various scenarios, edge cases, and user intents.
Strong skills in documenting these issues clearly, including steps to reproduce, expected vs. actual outcomes, and relevant prompt details.
Evaluating prompt performance under various loads, especially for API-driven interactions.
Defining and tracking metrics for prompt performance (e.g., accuracy rate, relevance score, hallucination rate, bias detection
Python programming Basics to do scripting to automate the prompt testing
Testing prompts to ensure they don't generate harmful, offensive, or inappropriate content, and adhering to Google's AI principles
Presenting test results and insights effectively using charts and graphs.
Basic Knowledge of how LLMs process information, their strengths (e.g., summarization, text generation, translation) and limitations (e.g., hallucinations, biases, factual inaccuracies, lack of real-time knowledge)
Expertise on AI Testing Techniques (Zero-shot prompting, Few-shot prompting, Chain of Thought, Feedback Loop, Tree-of-Thought)
Expertise NLP Concepts (tokenization, sentiment analysis, text summarization)
Ability to analyze how context, tone, length, and specific instructions in a prompt influence the AI's output.
Troubleshoot unexpected responses and optimize for specific metrics.
Critical & Analytical Thinking to generate AI Bot Test cases.
Ability to create comprehensive and diverse test cases specifically for prompts, covering various scenarios, edge cases, and user intents.
Strong skills in documenting these issues clearly, including steps to reproduce, expected vs. actual outcomes, and relevant prompt details.
Evaluating prompt performance under various loads, especially for API-driven interactions.
Defining and tracking metrics for prompt performance (e.g., accuracy rate, relevance score, hallucination rate, bias detection
Python programming Basics to do scripting to automate the prompt testing
Testing prompts to ensure they don't generate harmful, offensive, or inappropriate content, and adhering to Google's AI principles
Presenting test results and insights effectively using charts and graphs.
Thanks & Regards,
Pankaj Singh - Team Lead
Phone #
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.