Onboard Model Optimization and Integration Lead, Perception, Autonomy

    • Rivian
  • Palo Alto, CA
  • Posted 58 days ago | Updated 4 hours ago


On Site
Compensation information provided in the description
Full Time


Research and Development
Deep learning
Machine Learning (ML)
Software engineering
Computer science
Software architecture
Data security
Social media
Information security
Cloud computing
Law enforcement
Software deployment
Computer hardware
Software development
Electrical engineering
Mechanical engineering
Apache MXNet
Data compression

Job Details

About Rivian

Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract.

As a company, we constantly challenge what's possible, never simply accepting what has always been done. We reframe old problems, seek new solutions and operate comfortably in areas that are unknown. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future generations.

Role Summary

As Onboard Model Optimization and Integration Lead , you will be part of the Perception team at Rivian. Our perception team is a diverse group of algorithm developers focused on using sensor data (cameras/radars/lidars) to create a real-time virtual representation of the local environment around our vehicle s . This in turn allows the Autonomy team to deliver ADAS and Autonomy features to Rivian's customers.


In this role, you will be responsible for ensuring that our Deep Learning / Machine Learning models are optimized for onboard inference and successfully integrated into our production vehicles . This includes:

  • Working with model developers to ensure that models will meet latency and memory requirements of the onboard system
  • Optimizing model inference to meet onboard latency and memory requirements
  • Working with the broader Autonomy team to integrate model inference with the rest of the onboard software stack
  • Developing tools and processes to automate and streamline the model deployment process
  • Working with the hardware team to understand compute requirements for hardware acceleration for ML models and help drive decisions around future compute platforms

You will be responsible for managing a team of other engineers whose responsibilities include ;

  • Software engineering to accelerate model inference including programming for hardware accelerators
  • Model inference optimization through quantization, pruning , architecture search, knowledge distillation and other re lated techniques
  • Software engineering to integrate model inference with sensor drivers, middleware and other parts of the onboard stack
  • Testing and validation of the integration of the models on with the rest of the software stack
  • Development of tools and process to streamline the model deployment process
  • Validating the performance of models inference onboard


  • MS. or Ph.D. in Computer Science, Electrical, Mechanical, Aerospace Engineering or a related field.
  • Good team player with great communication skills to drive cross functional efforts in a fast-paced development environment.
  • Experience leading highly technical teams in relevant domain
  • Good understanding of the fundamentals of deep learning, heterogenous computing, ML accelerators and ML compilers with 7+ years of industrial experience.
  • Strong software engineering background in Python and C++ to enable direct mentorship of software engineers on team
  • Experience defining software architecture for efficient Deep learning inferencing.
  • Capability to understand hardware spec documents and performance profiling tools.
  • In-depth knowledge of at least one framework amongst P yTorch , TensorFlow or MXNet
  • Experience implementing inference logic from first principles using low level subroutines like BLAS, CUDA Kernels or C++ natively.
  • Familiarity with ONNX runtimes and DL compilers like XLA or Glow.
  • Research and development experience in the following areas ( preferred ) :
  • model compression and neural architecture search techniques
  • knowledge distillation, pruning, quantization and quantization aware training

Pay Disclosure

Salary Range for California Based Applicants: $228 ,000.00 - $ 285 ,000.00 (actual compensation will be determined based on experience, location, and other factors permitted by law).

Benefits Summary: Rivian provides robust medical/Rx, dental and vision insurance packages for full-time employees, their spouse or domestic partner, and children up to age 26. Coverage is effective on the first day of employment, and Rivian covers most of the premiums.

Equal Opportunity

Rivian is an equal opportunity employer and complies with all applicable federal, state, and local fair employment practices laws. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender, gender expression, gender identity, genetic information or characteristics, physical or mental disability, marital/domestic partner status, age, military/veteran status, medical condition, or any other characteristic protected by law.

Rivian is committed to ensuring that our hiring process is accessible for persons with disabilities. If you have a disability or limitation, such as those covered by the Americans with Disabilities Act, that requires accommodations to assist you in the search and application process, please email us at .

Candidate Data Privacy

Rivian may collect, use and disclose your personal information or personal data (within the meaning of the applicable data protection laws) when you apply for employment and/or participate in our recruitment processes ("Candidate Personal Data"). This data includes contact, demographic, communications, educational, professional, employment, social media/website, network/device, recruiting system usage/interaction, security and preference information. Rivian may use your Candidate Personal Data for the purposes of (i) tracking interactions with our recruiting system; (ii) carrying out, analyzing and improving our application and recruitment process, including assessing you and your application and conducting employment, background and reference checks; (iii) establishing an employment relationship or entering into an employment contract with you; (iv) complying with our legal, regulatory and corporate governance obligations; (v) recordkeeping; (vi) ensuring network and information security and preventing fraud; and (vii) as otherwise required or permitted by applicable law.

Rivian may share your Candidate Personal Data with (i) internal personnel who have a need to know such information in order to perform their duties, including individuals on our People Team, Finance, Legal, and the team(s) with the position(s) for which you are applying; (ii) Rivian affiliates; and (iii) Rivian's service providers, including providers of background checks, staffing services, and cloud services.

Rivian may transfer or store internationally your Candidate Personal Data, including to or in the United States, Canada, the United Kingdom, and the European Union and in the cloud, and this data may be subject to the laws and accessible to the courts, law enforcement and national security authorities of such jurisdictions.

Please note that we are currently not accepting applications from third party application services.