AI Infrastructure & Experience Engineer

Job Category: Technical Job Title: AI Infrastructure & Experience Engineer Duties: Key Responsibilities Inference Optimization: Deploy and tune multiple LLMs and generative multimodal models on local inference hardware. Optimize performance metrics (TTFT, tokens/sec) via model quantization, caching strategies, and architecture-specific adjustments. Systems Engineering & CUDA: Leverage deep knowledge of the CUDA environment to build custom kernels, ensuring maximum utilization of the l

Recent experience in model optimization requiredHardware & Compute:Proven experience with NVIDIA eco-systems and ARM64 architecture.Systems Programming:Advanced proficiency in C++, Python, and Rust. Deep familiarity with CUDA and the ability to author/debug custom CUDA kernels for compute-intensive tasks.AI/ML Frameworks:Extensive experience with modern inference engines (llama.cpp, TensorRT-LLM, Ollama) and orchestration frameworks (LiteLLM).Software Engineering:Robust understanding of asynchro

AI Inference Engineer Location:San Jose, CA Contract / C2H Duration: 6-12Months About the Role We are seeking a highly skilled AI Inference Engineer to join our team and drive the performance, scalability, and reliability of our large-scale model serving infrastructure. This role sits at the intersection of systems engineering, GPU optimization, and distributed infrastructure, and is ideal for someone who thrives on squeezing maximum performance out of production AI workloads. The ideal candida

Our team builds the foundational systems that power search across Apple - from Siri to Apple Music to the App Store and beyond. We develop agentic orchestration frameworks, configuration management infrastructure, services and APIs that enable product teams to deliver fast, reliable, and intelligent search experiences to hundreds of millions of users. We're looking for a Senior Software Engineer to design and build the distributed systems that underpin search at Apple scale. You will work at th