Overview
Remote
On Site
Hybrid
$48 - $53 hr
Contract - W2
Contract - Independent
Contract - 6+ mo(s)
Skills
RESEARCH SCIENTIST
RESEARCH ASSOCIATE
MACHINE LEARNING RESEARCHER
RESEARCH ASSISTANT
PHYSICS
PHYSICIST
LLM
LARGE LANGUAGE MODELS
MATHEMATICAL
Job Details
Payrate: 48.00 - $53.00/hr.
Summary:
As an LLM Evaluation Expert specializing in Physics, you will play a crucial role in assessing and improving our language models' Physics capabilities. Your expertise will be instrumental in evaluating LLM-generated Physics solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted Physics problem-solving.
Responsibilities:
Qualifications:
Preferred Qualifications:
Pay Transparency: The typical base pay for this role across the U.S. is: $48.00 - $53.00 /hr. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience and the benefits package you select. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, 10 paid days off, 401(k) plan participation, commuter benefits and life and disability insurance.
For information about our collection, use, and disclosure of applicant's personal information as well as applicants' rights over their personal information, please see our Privacy Policy (;/span>
Aditi Consulting LLC uses AI technology to engage candidates during the sourcing process. AI technology is used to gather data only and does not replace human-based decision making in employment decisions. By applying for this position, you agree to Aditi s use of AI technology, including calls from an AI Voice Recruiter.
#AditiConsulting
Summary:
As an LLM Evaluation Expert specializing in Physics, you will play a crucial role in assessing and improving our language models' Physics capabilities. Your expertise will be instrumental in evaluating LLM-generated Physics solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted Physics problem-solving.
Responsibilities:
- Critically analyze and evaluate Physics responses generated by our LLMs across various fields of Physics
- Exercise expert judgment to select the most appropriate and efficient Physics solutions from multiple LLM-generated options
- Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous Physics standards, are logically sound, and address specific research or application needs
- Develop and write Physics demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
- Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of Physics concepts
- Collaborate with the AI research team to identify areas for improvement in the LLM's reasoning and problem-solving capabilities
- Stay abreast with the latest developments in Physics and AI to ensure our evaluations remain cutting-edge
- Using your expertise, to provide step-by-step solutions and explanations to complex problems in Physics. This could include solving problems related to projectile motion, electromagnetic fields, wave interference, energy conservation, and relativity etc.
Qualifications:
- Advanced degree (Ph.D. preferred) in Physics or a closely related field
- Extensive experience (5+ years) in Physics research, problem-solving, or applied Physics across multiple subfields
- Demonstrated ability to critically evaluate Physics proofs, solutions, and reasoning for correctness, efficiency, and elegance
- Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts
- Excellent written and verbal communication skills, with the ability to explain complex Physics concepts clearly
- Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials
Preferred Qualifications:
- Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
- Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages
- Understanding of machine learning concepts, particularly as they apply to mathematical reasoning and problem-solving
- Experience in creating or contributing to Physics textbooks, research papers, or educational content.
Pay Transparency: The typical base pay for this role across the U.S. is: $48.00 - $53.00 /hr. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience and the benefits package you select. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, 10 paid days off, 401(k) plan participation, commuter benefits and life and disability insurance.
For information about our collection, use, and disclosure of applicant's personal information as well as applicants' rights over their personal information, please see our Privacy Policy (;/span>
Aditi Consulting LLC uses AI technology to engage candidates during the sourcing process. AI technology is used to gather data only and does not replace human-based decision making in employment decisions. By applying for this position, you agree to Aditi s use of AI technology, including calls from an AI Voice Recruiter.
#AditiConsulting
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.