AI Infrastructure & Experience Engineer

Job Category: Technical Job Title: AI Infrastructure & Experience Engineer Duties: Key Responsibilities Inference Optimization: Deploy and tune multiple LLMs and generative multimodal models on local inference hardware. Optimize performance metrics (TTFT, tokens/sec) via model quantization, caching strategies, and architecture-specific adjustments. Systems Engineering & CUDA: Leverage deep knowledge of the CUDA environment to build custom kernels, ensuring maximum utilization of the l

AI Inference Engineer Location:San Jose, CA Contract / C2H Duration: 6-12Months About the Role We are seeking a highly skilled AI Inference Engineer to join our team and drive the performance, scalability, and reliability of our large-scale model serving infrastructure. This role sits at the intersection of systems engineering, GPU optimization, and distributed infrastructure, and is ideal for someone who thrives on squeezing maximum performance out of production AI workloads. The ideal candida

Business Unit What the Role Entails 1.Architecture Research: Conduct in-depth research into the underlying hardware logic of various AI accelerators; evaluate the power-efficiency ratio and suitability of different heterogeneous architectures in the context of Large Language Model (LLM) inference and training. 2.Operator & Performance Optimization: Design and optimize high-performance operator libraries for large-scale cloud computing environments; resolve long-tail latency issues in hardware

Immigration sponsorship is not available for this position Responsibilities: Develop the Machine Learning Platform management system. Design and implement intuitive user interfaces and APls for seamless interaction with the platform. Ensure robust access control and security measures for the Machine Learning Platform. Regularly evaluate and enhance platform performance, scalability, and reliability. Integrate tools for data versioning, experiment tracking, and workflow orchestration. Build the t