Content Writer / Deep Research - Technical Writers

Job Details:
Team : UX Design & Research (Regular Temporary Staff Member)
Title: UX Writer & Content Designer 3
Position Description
Role: Content Writer / Deep Research - Technical Writers
Schedule: Hybrid T-TH San Jose, CA Minimum 3 days in office*
Payrate: $43.00/hr. - $57.96/hr.

Job Summary:
For LLM research evaluation, we need candidates with:

• Strong research skills (methodology, source evaluation, synthesis).
• Content expertise (writing, subject matter knowledge in finance, math, and science).
• Analytical abilities (problem-solving, logical reasoning).
• Technical skills (data curation, AI tools).
• LLM interaction skills (prompt engineering, output analysis, bias detection).
• Communication and collaboration skills.

• Research Methodology Understanding: Familiarity with different research approaches (qualitative, quantitative), experimental design, and data gathering techniques. This is crucial to evaluate if the LLM's output resembles sound research.
• Source Evaluation, Credibility Assessment, and Fact-checking: Ability to critically assess the reliability, authority, bias, and timeliness of information sources the LLM might use or cite.
• Identifying primary vs. secondary sources.
• Rigorous ability to verify claims, statistics, and factual assertions made by the LLM against trusted external sources. Proficiency with fact-checking tools and techniques.
  Information Synthesis: Skill in combining information from multiple sources to create a coherent and comprehensive understanding of a topic, and the ability to judge if the LLM does this effectively.

• Exceptional Writing & Editing: Strong command of grammar, style, clarity, and coherence to evaluate the LLM's output quality and potentially create high-quality training examples or refinement prompts.
• Understanding how to organize complex information logically for research papers, reports, summaries, etc., and evaluating the LLM's ability to do the same.
  Subject Matter Expertise (or Ability to Acquire Quickly): Candidate should have deep knowledge in domains such as finance, Math and Science (Physics).
• While needing expertise in the mentioned fields, having depth in certain areas or the ability to quickly learn and understand new complex topics is vital for evaluating the nuances and accuracy of the LLM's research output in specific domains.

• Problem-Solving and Pattern Recognition: Analyzing why the LLM fails on certain research tasks and suggesting potential improvements (e.g., better prompts, need for specific fine-tuning data, model adjustments).

• Identifying recurring errors, biases, or weaknesses in the LLM's research outputs across different prompts and topics.
  Logical Reasoning Assessment: Evaluating the soundness of arguments, inferences, and conclusions presented by the LLM.

• Data Curation/Annotation: Experience or understanding of how data is prepared, cleaned, and labeled for training or fine-tuning AI models, especially data related to research tasks.
• Familiarity with AI Tools & Platforms: Comfort using specific platforms for LLM testing, evaluation, and potentially data annotation. Basic understanding of concepts like APIs might be helpful.
  LLM Interaction & Evaluation:
• Prompt Engineering: Skill in crafting precise, effective prompts to test the LLM's research capabilities thoroughly, probe for weaknesses, and elicit specific types of research-oriented outputs (e.g., literature summaries, data analysis requests, hypothesis generation).
• Output Analysis & Evaluation: Critically assessing LLM outputs based on defined criteria such as accuracy, relevance, depth, coherence, safety, bias, logical consistency, and adherence to research standards. Identifying issues like hallucination, factual errors, or superficial analysis.
• Bias Detection: Ability to recognize and flag various forms of bias (e.g., confirmation bias, demographic bias, ideological slants) in the LLM's output and potentially in the data it was trained on.
• Understanding LLM Limitations: Knowing the common failure modes of LLMs (e.g., making things up, knowledge cutoffs, lack of true reasoning) and how these might manifest in research tasks.

• Clear Feedback: Articulating findings, evaluations, and specific examples of LLM errors or successes clearly to technical teams (engineers, researchers).
  Collaboration: Working effectively with cross-functional teams involved in LLM development.

• Native English-speaking resources with one or more of the qualifications.
• Knowledge in Finance Domains.
• Ph.D./master s in political science/Linguists /creative writing/ content writing/Arts/ essay writing/scripts or English.
• Excellent written, Verbal Communication and Interpersonal skills including familiarity with local cultures.
• Proficiency in using computers.
• The individual should be able to understand and carry out the allocated tasks and responsibilities promptly and consistently and deliver results to exceed one's own standards.
• Ensure the accuracy and timeliness of data feeds and flows for the process and produce, review and record quarterly results.
• Strong work ethic and ability to work with minimal supervision.
• Analytical thinking and independent decision-making skills.
• Team players with an exceptional interpersonal and solution-oriented attitude.
• Skill/Experience/Education
  

• Excellent writing and editing skills for a broad range of audience s Strong prioritization, organization, and project management skills; ability to find the right balance between process and flexibility. interest in software, machine learning, data and finance

• Ability to manage multiple competing priorities in a fast-paced, constantly changing environment Self-driven with ability to work independently Experience working with user research, data, and customer feedback; ability to synthesize these into specific content choices as well as a broader content strategy

Pride Global offers eligible employee's comprehensive healthcare coverage (medical, dental, and vision plans), supplemental coverage (accident insurance, critical illness insurance and hospital indemnity), 401(k)-retirement savings, life & disability insurance, an employee assistance program, legal support, auto, home insurance, pet insurance and employee discounts with preferred vendors.