Systems Designer | $80/hr Remote

At Crossing Hurdles, we work as a referral partner. We refer candidates to Mercor that collaborates with the world’s leading AI research labs to build and train cutting-edge AI models.

Organization: Mercor
Position: Software Engineering & Systems Design Expert
Referral Partner: Crossing Hurdles
Type: Hourly Contract
Compensation: $45–$80/hour
Location: Remote
Commitment: 10–40 hours/week

Role Responsibilities (Training support will be provided)

• Evaluate AI-generated responses to software engineering and systems design questions for accuracy, reasoning, clarity, and completeness.
• Execute and validate code to verify correctness, outputs, and edge-case handling.
• Assess code quality, readability, algorithmic soundness, and explanation depth.
• Annotate model outputs by identifying strengths, weaknesses, and factual or conceptual errors.
• Apply consistent evaluation standards using defined taxonomies, benchmarks, and guidelines.
• Ensure AI responses align with expected conversational behavior and engineering best practices.
  
  

Requirements

• Degree in Computer Science or a closely related field.
• Strong real-world experience in software engineering or systems design roles.
• Expertise in at least one programming language such as Python, Java, C++, JavaScript, Go, or Rust.
• Ability to independently solve medium-to-hard algorithmic problems.
• Experience reviewing or contributing to production or open-source codebases.
• Strong attention to detail and comfort evaluating complex technical reasoning.
  
  

Application process (Takes 20 min)

• Upload resume
• AI interview based on your resume (15 min)
• Submit form