Senior Staff AI Engineer - LLM inference optimization

Senior Staff AI Engineer LLM inference optimization

Roles and Responsibilities:

• Design and architect technical solutions to deliver foundational AIOS capabilities within SkyOS across ECU domains in electric vehicles (EVs).
• Lead the development of proof-of-concept projects to evaluate architectural designs for functionality, performance, security, and reliability.
• Collaborate closely with engineering teams to understand real-world development constraints and ensure high-quality implementation, validation, and integration of AIOS designs.
• Define the technical roadmap for the evolution of AIOS solutions.
• Develop and communicate clear requirements to guide the development team.
• Continuously monitor industry trends and analyze competitors technical approaches.

Required Qualifications:

• 5+ years of experience in software design and development focused on AI model inference optimization, and deployment.
• Strong knowledge of Large Language Models (LLMs) with expertise in optimizing inference on resource-constrained edge devices. Vision-Language Models (VLMs) are a plus.
• Hands-on experience with cutting-edge AI models and frameworks.
• Solid background in GPU/NPU architectures and AI training frameworks such as PyTorch, TensorFlow, or similar.
• 7+ years of experience building complex software systems.
• Proficiency in C/C++ and Python programming languages.

Preferred Qualifications:

• Expertise in optimizing AI models for inference on edge devices.
• Experience with performance tuning and inference optimization for deep learning models across various hardware platforms.
• Deep understanding of computer architectures, including CPU, MPU, GPU, and NPU technologies.
• Solid foundation in embedded and mobile operating systems.
• Familiarity with microkernel architectures, Linux kernel development, hypervisors, middleware, and application frameworks.

Estimated Min Rate: $200,000.00
Estimated Max Rate: $300,000.00

Note: Any pay ranges displayed are estimations. Actual pay is determined by an applicant's experience, technical expertise, and other qualifications as listed in the job description. All qualified applicants are welcome to apply.

Yoh, a Day & Zimmermann company, is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Visit to contact us if you are an individual with a disability and require accommodation in the application process.

For California applicants, qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. All of the material job duties described in this posting are job duties for which a criminal history may have a direct, adverse, and negative relationship potentially resulting in the withdrawal of a conditional offer of employment.