Overview
On Site
Compensation information provided in the description
Contract - Independent
Skills
Workflow
Python
Bash
Scripting
Reporting
Orchestration
Problem Solving
Conflict Resolution
Oracle Linux
Artificial Intelligence
Machine Learning (ML)
Quality Assurance
Evaluation
Benchmarking
Privacy
Marketing
Job Details
Location: Mountain View, CA
Salary: $110.00 USD Hourly - $115.00 USD Hourly
Description:
Job Title: Software Engineer (Iii)
Location: Mountain View , CA - Hybrid
Work Schedule: Monday to Friday, PST hours
Based on the job description you shared for the Software Engineer role, here's a breakdown of the key skills and qualifications they're looking for:
Core Responsibilities
Required Skills & Expertise
Ideal Candidate Profile
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Salary: $110.00 USD Hourly - $115.00 USD Hourly
Description:
Job Title: Software Engineer (Iii)
Location: Mountain View , CA - Hybrid
Work Schedule: Monday to Friday, PST hours
Based on the job description you shared for the Software Engineer role, here's a breakdown of the key skills and qualifications they're looking for:
Core Responsibilities
- Implement and automate offline quality evaluations for coding agents.
- Manual execution of experiments and evaluations.
- Build infrastructure to automate and streamline evaluation workflows.
- Write scripts/code to reduce manual effort in launching and reporting experiments.
- Design experiments based on high-level guidance, and define lower-level implementation details.
Required Skills & Expertise
- Programming & Scripting
- Strong coding skills (likely in Python, Bash, or similar scripting languages).
- Ability to write automation scripts and tools for experiment setup and reporting.
- Experimentation & Evaluation
- Experience with designing and running software experiments.
- Familiarity with quality evaluation methodologies (especially for coding agents).
- Infrastructure & Automation
- Building systems or pipelines to automate repetitive tasks.
- Experience with tools or platforms that support experiment orchestration.
- Coding Agents Knowledge
- Understanding of how coding agents (e.g., AI code generators) work.
- Ability to evaluate their performance and quality.
- Independent Problem Solving
- Ability to take high-level requirements and define detailed implementation plans.
- Comfortable making decisions on experiment design after initial ramp-up.
Ideal Candidate Profile
- Has worked with AI/ML models, especially coding agents.
- Has experience in quality assurance, evaluation frameworks, or benchmarking.
- Is comfortable with a mix of manual and automated work.
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.