Search Jobs | Dice.com

Job Details

Skills

Elasticsearch
Relevance Evaluator
AI Evaluator
Content Reviewer
Search Engine Evaluator
Search Evaluator
KQL
Kibana Query Language
relevance rater

Summary

About the role:

As a relevance evaluator you will be responsible for evaluating how relevance a given document (or image, video) is for a particular user query.
You will have to rate the document relevance 1-5 (from not relevant at all to exactly what the user was looking for).
Rating relevance requires first trying to understand the user intent, for example, where they researching a topic, or they were looking for their own document, and forming an opinion what would be a good document (or image, etc.) for this particular query for this particular user.
Other similar tasks involve evaluating quality of assistant answers, including various aspects of the answer: is it correct (the information answers the user intent correctly), is it descriptive, or is the system apologizing for not knowing the answer. Understanding correctness also requires some research on the terminology used.

Responsibilities:

Responsibility includes reviewing the query and document pairs, including any context provided by the system (such as when the query was issued and who did it), researching the problem trying to understand the user intent by using the product (search, including formulating queries for elastic search index in KQL), and then rating the document or other required artifact (e.g. assistant answer) according to the provided relevance rubric.

Requirements:

Understanding of English
Ability to formulate search or chatgpt-like queries

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 90989446
Position Id: 9032311
Posted 3 days ago

Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Contact the job poster

Ajit Maurya

Amiseq Inc. Recruiter @ Amiseq Inc.

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

AI Evaluation Opportunities -- Remote

Remote

•

9d ago

Hi Greetings from Smart Folks My name isKumarwe have a job opportunity for you asAI Evaluation Opportunities of our client basedatRemote find the Job description below, if you are available and interested, please send us your word copy of your resume with following detail toOr please call me onto discuss more about this position. Job Title: AI Evaluation Opportunities Location: Remote Duration:03 Months Start Date:ASAP Job Details: Key Responsibilities We have a new client opportunity under th

Easy Apply

Contract

Depends on Experience

Senior Data Scientist - Shopping Experience (Search)

Remote

•

Today

We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible

Full-time

USD 194,000.00 - 204,500.00 per year

Content Audit & Content Optimization (Remote)

Remote or Draper, Utah

•

Today

RESPONSIBILITIES: Kforce has a client that is seeking a Content Audit and Content Optimization for a remote role. Overview: Our client is seeking a Content Audit and Content Optimization Consultant to evaluate, analyze, and elevate the effectiveness, consistency, and usability of content across our digital member ecosystem. Working across web, mobile apps, member portals, onboarding flows, educational resources, and engagement messaging, this consultant will conduct an end-to-end audit of our c

Contract

$40 - $50 hourly

Content Author

Remote

•

Today

Job Title: Email Content Author Adobe Journey Optimizer (AJO) Extended Contract $45/hr Position Overview We are seeking a detail-oriented and technically savvy Email Content Author to support lifecycle marketing efforts within Adobe Journey Optimizer (AJO). This role is responsible for the end-to-end execution of omni-channel campaigns, including email, push notifications, and SMS, ensuring content is built, scheduled, tested, and deployed with precision. The ideal candidate combines strong co

Easy Apply

Contract

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Content Evaluator/Reviewer

Skills

Summary

Dice Job Match Score™

Ajit Maurya

Similar Jobs

Content Evaluator/Reviewer

Job Details

Skills

Summary

Dice Job Match Score™

Ajit Maurya

Similar Jobs