Research & Technical Expert – STEM Problem Design

Job Description:
We are seeking high-caliber researchers and technical experts to join a specialized program focused on advancing reasoning and problem-solving capabilities in STEM domains. The role involves designing, validating, and analyzing challenging benchmark tasks to support frontier STEM research. Initial tasks will focus on data science, machine learning, and coding.

Key Responsibilities:

• Task Design and Development: Create challenging, real-world STEM problems that serve as benchmark tasks, targeting specific reasoning and problem-solving challenges.
• Content Generation: Develop all necessary task components using Python, including:
• Detailed instructions and task overview
• A reference solution following the instructions
• Supporting environment, including datasets, libraries, and metadata
• A test notebook with unit tests for solutions
• Evaluation and Analysis: Assess model or algorithm performance on designed tasks.
• Failure & Capability Analysis: Identify tasks where models or systems fail to pass tests, categorize reasoning failures, and analyze solution steps to extract patterns of capability loss.

Qualifications:

• Strong expertise in data science, machine learning, and coding.
• Experience in designing challenging STEM problems and evaluating model or algorithm performance.
• Able to commit 30+ hours per week.
• Open to advanced researchers, including PhD students or highly skilled contributors from global platforms.