Systems Engineer - Evaluation Engineering

Cupertino, CA, US • Posted 6 days ago • Updated 3 days ago
Full Time
On-site
Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

  • Static Testing
  • Real-time
  • Dashboard
  • Evaluation
  • iPhone
  • iPad
  • Computer Science
  • Concurrent Computing
  • Python
  • Java
  • GraphQL
  • Database
  • Modeling
  • PostgreSQL
  • Analytical Skill
  • Messaging
  • Apache Kafka
  • Amazon SQS
  • RabbitMQ
  • Redis
  • Streaming
  • Kubernetes
  • Orchestration
  • Cloud Computing
  • Amazon Web Services
  • Google Cloud Platform
  • Google Cloud
  • Microsoft Azure
  • Terraform
  • Management
  • Continuous Delivery
  • GitHub

Summary

We are looking for a Distributed Systems Engineer to own the infrastructure powering our core Siri Agentic Evaluation Platform. Evaluation is no longer just a static test suite-it is a highly dynamic, massive-scale distributed problem. Our platform enables teams to run high-throughput agentic simulations, orchestrate multi-model judging pipelines, and generate real-time observability dashboards across billions of tokens and complex data types.\\n

In this role, you will design the execution engine that coordinates these complex evaluation loops. You will build systems that remain deterministic, fault-tolerant, and cost-efficient, even when coordinating massive parallel requests across heterogeneous device types(iPhones, Mac, iPads etc).\n

MS in computer science or equivalent\n7+ years of experience as distributed systems engineer, platform engineer or equivalent\nSystems & Backend Languages: Strong proficiency in languages optimized for concurrency and enterprise scale, such as Python (asyncio) or Java\nAPI Design & Ecosystems: Deep expertise in designing robust, versioned production APIs using gRPC/Protobuf, GraphQL, or REST (FastAPI)

Relational & Analytical Databases: Strong experience modeling complex relational data and trace hierarchies using PostgreSQL, combined with high-throughput analytical query layers.\nOrchestration & Messaging: Experience designing asynchronous, event-driven architectures using Kafka, AWS SQS/SNS, RabbitMQ, or Redis Streams.\nCloud Native Architecture: Advanced experience with Kubernetes (orchestration, custom operators, service meshes like Istio or Linkerd) and cloud providers (AWS, Google Cloud Platform, or Azure).\nExperience building Agentic RAG platforms or developer-facing infrastructure tooling.\nInfrastructure-as-Code (IaC): proficiency with Terraform to manage infrastructure declaratively.\nCI/CD & DevEx: Experience building automated, containerized deployment pipelines (GitHub or ArgoCD) with an emphasis on keeping developer feedback loops fast and reliable.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90733111
  • Position Id: 9547e3459091f6a40e2e2c320ae028bb
  • Posted 6 days ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Mountain View, California

3d ago

Full-time

Mountain View, California

3d ago

Full-time

Mountain View, California

3d ago

Full-time

Mountain View, California

3d ago

Full-time

USD 170,000.00 - 265,000.00 per year

Search all similar jobs