Senior ML Training GPU Optimization Engineer

    • Adobe Systems
  • Seattle, WA
  • Posted 60+ days ago | Updated 7 hours ago

Overview

On Site
USD 170,900.00 - 325,200.00 per year
Full Time

Skills

C++
Performance analysis
Deep learning
Distributed computing
IaaS
Resource management
Computer science
Computer engineering
Machine Learning (ML)
Training
GPU
Optimization
CUDA
PyTorch
Data
Linux
Ansible
Docker
Kubernetes
Python
OpenCL
Amazon Web Services
Software deployment

Job Details

JOB LEVEL
P55
EMPLOYEE ROLE
Individual Contributor

What you will be working on:



  • Write efficient forward and backward passes in CUDA/CuTe.
  • Write Optimized custom layers in Pytorch.
  • Optimize ML training code for large, distributed training with FP8.
  • Quality and performance analysis between data types such as BF16 and FP8 for large deep learning models.
  • Understand and optimize H100 GPUs.
  • Architect broader, end to end optimized training code and schemes with Pytorch for large distributed models.
  • Write high quality, product level code that is easy to maintain and test following standard methodologies.



What do you need to succeed:



  • Proficiency in at least two of: Linux, Ansible, Docker, Kubernetes (5+ yrs)
  • Expert in Python and or C++
  • Expert in CUDA/CuTe, OpenCL and or Triton
  • Expert in Pytorch
  • Experience with DDP, FSDP
  • Experience in distributed computing (7+ yrs)

  • Experience working with AWS or similar cloud infrastructure (5+ yrs)
  • Experience with HW resource management for ML training and/or deployment
  • B.S., M.S, or Ph.D. in Computer Science, Computer Engineering or a related area

#FireflyGenAI



Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this positionis $170,900 -- $325,200 annually. Paywithin this range varies by work locationand may also depend on job-related knowledge, skills,and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process.

At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).

In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.

Internal Opportunities

Creativity, curiosity, and constant learning are celebrated aspects of your career growth journey. We're glad that you're pursuing a new opportunity at Adobe!

Put your best foot forward:

1. Update your Resume/CV and Workday profile - don't forget to include your uniquely 'Adobe' experiences and volunteer work.

2. Visit the Internal Mobility page on Inside Adobe to learn more about the process and set up a job alert for roles you're interested in.

3. Check out these tips to help you prep for interviews.

4. If you are applying for a role outside of your current country, ensure you review the International Resources for Relocating Employees on Inside Adobe, including the impacts to your Benefits, AIP, Equity & Payroll.

Once you apply for a role via Workday, the Talent Team will reach out to you within 2 weeks. If you move into the official interview process with the hiring team, make sure you inform your manager so they can champion your career growth.

At Adobe, you will be immersed in an exceptional work environment that is recognized around the world. You will also be surrounded by colleagues who are committed to helping each other grow through our unique Check-In approach where ongoing feedback flows freely. If you're looking to make an impact, Adobe's the place for you. Discover what our employees are saying about their career experiences on the Adobe Life blog and explore the meaningful benefits we offer.

Adobe is an equal opportunity and affirmative action employer. We welcome and encourage diversity in the workplace regardless of gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other characteristics protected by law.

If you have a disability or special need that requires accommodation to navigate our internal careers site or to complete the application process, please contact