Outage
We're experiencing some issues with our login system. Some login attempts may show "Incorrect Password" even with the correct password. We are working to resolve this as quickly as possible.

Software Engineer - Evaluation Engineering

Cupertino, CA, US • Posted 60+ days ago • Updated 4 hours ago
Full Time
On-site
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Privacy
  • Management
  • IOS Development
  • OS X
  • Artificial Intelligence
  • Shipping
  • Reporting
  • UI
  • Command-line Interface
  • Web Applications
  • TypeScript
  • React.js
  • Visualization
  • Python
  • API
  • Code Review
  • Mentorship
  • Communication
  • Computer Science
  • Analytical Skill
  • PostgreSQL
  • Analytics
  • Migration
  • Machine Learning (ML)
  • Evaluation
  • Workflow

Summary

Join the team redefining what a deeply personal and integrated assistant can be.

As part of the Siri organization, you will help shape one of the world's most widely used AI assistants, powered by our next-generation of Apple Intelligence, with capabilities like personal context understanding and on-screen awareness, built with privacy from the ground up. Your work will have direct, meaningful impact for users across iOS, iPadOS, macOS, watchOS, and visionOS.

This is a rare opportunity to build at the intersection of cutting-edge AI and human-centered design, shipping technology that is centered around users and their needs.

Description

We are looking for a Full-Stack Software Engineer to own the user-facing UI of our evaluation platform. Teams across Siri and Apple Intelligence use our web console to create, run, browse, and compare evaluation jobs at scale. You will set the front-end's engineering standards and help drive the service APIs and data queries behind agent flows, the UI, and other clients, working with the services and data teams.

The hardest problems here are data-dense. Scenario browsing, job comparison, and cost reporting are limited by how evaluation data is stored and queried, not by the UI layer. You will help shape the query and aggregation side with the data backend, then build the interface on top. You will partner with the pipeline, device, evaluator, and CLI teams rather than work inside their internals.

Minimum Qualifications

5+ years building production web applications. Strong TypeScript and a modern framework (React).

Experience with data-heavy UIs: large tables, filtering, comparison, and visualization.

Working proficiency in Python, with experience collaborating on typed API contracts (OpenAPI or generated clients) with backend teams.

Experience owning or leading a codebase or major area: code review, setting patterns, and mentoring contributors.

Strong cross-team communication.

BS or MS in Computer Science or equivalent experience

Preferred Qualifications

Experience with analytical or relational data backends (for example, PostgreSQL and query or aggregation design). You should be able to reason about why a view is slow and fix it at the query layer.

Experience building internal developer platforms or analytics consoles.

Experience leading framework upgrades and migrations in a live codebase.

Familiarity with ML/LLM evaluation workflows, such as judging, traces, and cost or token metering.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90733111
  • Position Id: 9547e3459091f6a40e2e2c320ae028bb
  • Posted 30+ days ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.