Job DescriptionSoftware Engineer - Coding Benchmarks & RL Environments
\\n
\\n
Experience: Professional Software Engineering Experience Required
\\n
Job Type: Contractor
\\n
Location: Remote
\\n
Compensation: $45-$75/hour
\\n
Payment: Weekly
\\n
Required Profiles: LinkedIn & GitHub
\\n
\\n
Role Overview\\n
We are looking for
Software Engineers to design realistic coding tasks used to
train and evaluate frontier AI coding agents. The core application stack includes
TypeScript, React, Node.js, SQLite, and Playwright, with opportunities to work across backend technologies such as
Go, Rust, Java, gRPC, APIs, and system-level components.
\\n
\\n
Key Responsibilities\\n
\\n - Design realistic software engineering benchmark tasks based on real-world development scenarios.
\\n - Create tasks across full-stack web applications, backend services, APIs, and system integrations.
\\n - Write robust automated tests and validation logic for AI-generated solutions.
\\n - Build features and challenges using React, Node.js, TypeScript, SQLite, and Playwright.
\\n - Design backend-focused tasks involving Go, Rust, Java, gRPC, rate limiting, and services.
\\n - Use AI coding tools to assist with coding and testing where appropriate.
\\n - Work independently from written technical requirements and documentation.
\\n
\\n
\\n
Key Requirements\\n
\\n - Strong professional experience in Software Engineering.
\\n - Hands-on experience across both frontend and backend development.
\\n - Experience building and debugging production-quality systems.
\\n - Strong understanding of automated testing and software quality.
\\n - Experience with modern web technologies, preferably TypeScript, React, and Node.js.
\\n - Availability for 10-20+ hours per week.
\\n - Active LinkedIn and GitHub profiles are required.
\\n
\\n
\\n
Preferred Technical Skills\\n
Frontend: React, TypeScript, JavaScript
\\n
Backend: Node.js, Go, Rust, Java
\\n
Testing: Playwright, automated testing, integration testing
\\n
Data: SQLite, SQL, databases
\\n
Systems: REST APIs, gRPC, rate limiting, distributed services
\\n
Tools: Git, GitHub, AI coding tools
\\n
\\n
Selection Process1:\\n
Step 1 - Short Screener
\\n
Step 2 - AI Interview
\\n
Step 3 - Paid Work Trial
\\n
Step 4 - Project Onboarding
Never miss an opportunity! Create an alert based on the job you applied for.
