AIML - Machine Learning Manager, Red Teaming - Responsible AI and Safety

San Francisco, CA, US • Posted 1 day ago • Updated 10 hours ago
Full Time
On-site
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • FOCUS
  • Research
  • Privacy
  • User Experience
  • Computer Science
  • Machine Learning (ML)
  • Statistics
  • Evaluation
  • Product Development
  • Writing
  • Python
  • Artificial Intelligence
  • Generative Artificial Intelligence (AI)

Summary

Apple's Responsible AI and Safety team focuses on innovative technologies, methodologies, and research to enable fantastic user experiences and to push the frontier of machine learning. Our team is looking to hire a leader with a strong track record in Applied Research, who is passionate about ML and foundation models with a focus on responsibility, fairness, and safety. In this role, you will lead the research and application of ML methods for technologies that power breakthrough user experiences while upholding Apple's values, privacy, and quality standards.

Description

This role focuses on leading a team working on developing, carrying-out, interpreting, and communicating pre- and post-ship evaluations of the safety of Apple Intelligence features. This team is also responsible for producing safety evaluations that uphold Apple's Responsible AI values requires thoughtful data sampling, creation, and curation for evaluation datasets; high quality, detailed annotations and careful auto-grading to assess feature performance; and mindful analysis to understand what the evaluation means for the user experience.

Minimum Qualifications

MS, or PhD in Computer Science, Machine Learning, Statistics, or related fields; or an equivalent qualification acquired through other avenues.

Experience working with generative models for evaluation and/or product development, and up-to-date knowledge of common challenges and failures.

Strong engineering skills and experience in writing production-quality code in Python.

Deep experience in foundation model-based AI programming (i.e.: using DSPy for optimizing foundation model prompts, for example) and a drive to innovate in this space.

Experience working with noisy, crowd-based data labels and human evaluations.

Preferred Qualifications

Publication record in relevant conferences (e.g., NeurIPS, ICML, ICLR, EMNLP, etc.)

Experience working on Responsible AI and AI Safety

Strong organizational and operational skills working with large, multi-functional, and diverse teams.

Curiosity about fairness and bias in generative AI systems, and a strong desire to help make the technology more equitable.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90733111
  • Position Id: 6ee591046602d3a56940d248d1dfe630
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

San Francisco, California

Today

Full-time

Remote or San Francisco, California

Today

Full-time

USD 112,300.00 - 134,800.00 per year

Cupertino, California

Today

Full-time

Redwood City, California

Today

Full-time

USD 150,000.00 - 198,000.00 per year

Search all similar jobs