Senior Machine Learning Engineer, Conversational AI - Services Special Projects

Cupertino, CA, US • Posted 3 hours ago • Updated 3 hours ago
Full Time
On-site
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Generative Artificial Intelligence (AI)
  • Reasoning
  • Natural Language
  • Real-time
  • Honesty
  • Workflow
  • FOCUS
  • Python
  • Java
  • Scala
  • Shipping
  • Management
  • Orchestration
  • Optimization
  • Caching
  • Fluency
  • PyTorch
  • Cloud Computing
  • Amazon Web Services
  • Docker
  • Kubernetes
  • Communication
  • Computer Science
  • Machine Learning (ML)
  • Natural Language Processing
  • Adapter
  • Graph Databases
  • Neo4j
  • Apache Cassandra
  • Redis
  • Privacy
  • Evaluation
  • Data Modeling
  • Service Design
  • Patents
  • Artificial Intelligence
  • Information Retrieval

Summary

At Apple, great ideas have a way of becoming phenomenal products, services, and customer experiences very quickly. We're building a massive, real-time conversational experience from the ground up, one that will reach users at Apple scale. It sits at the intersection of Generative AI, Information Retrieval, and Knowledge Graphs.

We're looking for a senior machine learning engineer to own the conversational intelligence layer: the agent's reasoning and tool-calling, the low-latency LLM inference behind it, and the knowledge services that keep every response accurate and grounded. You'll partner closely with teams across Apple to bring it to production.

Description

This is a hands-on role for an engineer who has shipped conversational AI and LLM systems to production and cares about latency as much as model quality. You'll work closely with AI/ML scientists and engineers across the stack. You'll design multi-turn conversational experiences, build agent logic that plans and calls tools, and develop query understanding models that turn natural language into structured intent. You'll also make large and small models fast and cost-efficient enough to serve in real time.

Just as importantly, you'll help make sure every response is accurate and grounded. You'll build and scale knowledge graph services that resolve, enrich, and expand user requests with low latency and also connect the system to real-time data sources so its answers stay current. Finally, you'll build the evaluation that keeps all of it honest: automated and LLM-as-judge evaluation for multi-turn conversations, built into the development workflow so regressions are caught before they reach users.

Minimum Qualifications

Master's degree in Computer Science, Machine Learning, NLP, or a related field

7+ years of experience as a software or machine learning engineer, with a significant focus on conversational AI, search, or LLM-powered systems

Strong programming skills in Go and Python, plus at least one of Java or Scala

Hands-on experience building and shipping conversational AI or dialogue systems: intent and slot understanding, multi-turn context management, clarification, and disambiguation

Experience building LLM-powered applications in production, including prompt design, tool/function calling, structured output generation, and agentic orchestration patterns

Demonstrated LLM inference-optimization experience: distillation, quantization, batching, KV-cache tuning, caching, and profiling to find real bottlenecks rather than guessing at them

Hands-on experience deploying and serving LLMs or ML models directly in the production request path, using serving frameworks such as vLLM, SGLang, Triton, or TorchServe

Experience with knowledge graphs and low-latency lookup and retrieval services

Fluency with PyTorch and the Hugging Face ecosystem (transformers, PEFT)

Familiarity with cloud environments (including AWS) and containerization (Docker, Kubernetes)

Excellent communication skills and a collaborative mindset

Preferred Qualifications

Ph.D. in Computer Science, Machine Learning, NLP, or a related field

Experience fine-tuning and distilling LLMs for task-specific use, such as query parsing, classification, and response generation, using techniques such as LoRA/adapters and teacher/student setups

Experience designing knowledge graph schemas, building graph compilation and ingestion pipelines, and working with graph databases such as TigerGraph or Neo4j

Deep experience with KV stores and in-memory serving for low-latency lookups (e.g., Cassandra, Redis, SSTables)

Experience calibrating LLM judges against human judgments for multi-turn conversations, including inter-annotator agreement and judge reliability tracking

Experience with personalization and memory in conversational systems, and applying privacy principles such as data minimization and on-device processing

Experience implementing safety guardrails for LLM-powered agents, including prompt-injection defenses and adversarial evaluation

Familiarity with experiment tracking and data/model versioning tools (MLflow, Weights & Biases, DVC)

Deep understanding of distributed systems and service design, and experience architecting and leading projects with cross-functional stakeholders

Published work or patents in conversational AI, information retrieval, knowledge graphs, or efficient inference
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90733111
  • Position Id: a5f5aa80e68080856a9439bd47ce3089
  • Posted 3 hours ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.