RESPONSIBILITIES:
A client with Kforce is seeking an Information Designer II to join the AI Evaluations team in Mountain View, CA. As a conversation designer you would build golden datasets, analyse AI answers at scale and provide insights on quality and accuracy.
Key Responsibilities:
* Identify and prioritize opportunities to improve customer experiences and drive business goals in conversational products like chatbots and voice assistants
* Develop end-to-end conversation principles, design strategy, playbooks etc and get alignment from stakeholders like engineering and data science
* Build AI skills (Claude Code or similar) for generating golden datasets for AI evaluations
* Perform offline and online AI answer evaluations at scale with LLM-as-a-judge models and human-in-the-loop
* Drive multiple projects with adherence to deadlines, quality and business metrics
REQUIREMENTS:
* Bachelor's degree; Education or certifications in Interaction Design, HCI, Psychology, Computer Science, Prompt engineering or related field preferred
* 8 years of design experience, with at least 4 years of conversation design experience and 1year working on AI agentic platforms
* Expertise in data analysis, prompt engineering and AI tools to efficiently deliver artefacts like golden datasets, trends in user responses etc
* Knowledge of language modeling and machine learning frameworks (such as NLUs, RAG databases, TensorFlow, PyTorch, or similar).
* Working understanding of code (html, python, xml, regex) in order to create dynamic dialog-flows using Boolean logic and decision frameworks
* Exceptional communication skills, both written and verbal
* Strong leadership skills, with a proven track record of managing stakeholders, mentoring team members and developing talent
* Experience in conducting user research and usability testing, experiment design and data analysis
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: kforcecx
- Position Id: ITWQG2194297
- Posted 4 hours ago
