AI Infrastructure & Experience Engineer

Mountain View, CA, US • Posted 3 days ago • Updated 3 days ago
Contract W2
Contract Independent
12 Months
Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

  • LLM Inference Optimization
  • CUDA Development
  • AI Orchestration

Summary

  • Recent experience in model optimization required
  • Hardware & Compute: Proven experience with NVIDIA eco-systems and ARM64 architecture.
  • Systems Programming: Advanced proficiency in C++, Python, and Rust. Deep familiarity with CUDA and the ability to author/debug custom CUDA kernels for compute-intensive tasks.
  • AI/ML Frameworks: Extensive experience with modern inference engines (llama.cpp, TensorRT-LLM, Ollama) and orchestration frameworks (LiteLLM).
  • Software Engineering: Robust understanding of asynchronous programming (FastAPI), containerization (Docker/Kubernetes), sandbox environments, and API design for low-latency communication.
  • Full-Stack Prototyping: Ability to quickly spin up modern frontend UIs (React, Next.js, or similar) to present AI-driven intelligence to end users.
  • Communication Protocols: Familiarity with WebSockets, gRPC, and REST for device-to-device communication in a local network environment.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10427688
  • Position Id: 8994439
  • Posted 3 days ago
Contact the job poster
MT

Maurya Teja

Recruiter @ Prospance Inc.
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in Santa Clara, California

25d ago

Easy Apply

Contract

Depends on Experience

Santa Clara, California

Today

Full-time

USD 203,000.00 per year

Sunnyvale, California

11d ago

Easy Apply

Contract

45 - 65

Santa Clara, California

Today

Full-time

USD 104,904.00 - 218,550.00 per year

Search all similar jobs