GPU Software Engineer/GPU Architect

San Jose, CA, US • Posted 60+ days ago • Updated 3 days ago
Contract W2
60 Months
No Travel Required
On-site
$100+
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • C++
  • CUDA
  • GPU
  • Remote Direct Memory Access
  • PyTorch
  • OpenCL
  • Artificial Intelligence

Summary

Role: GPU Software Engineer/GPU Architect
Location: San Jose, CA
Duration: Long-term >> ongoing contract
 
Overview: We're looking for a strong GPU Software Engineer/GPU Architect to join a highimpact engineering team working on nextgeneration AI, GPU, and semiconductor technologies. This role focuses on GPU kernel development, memory architecture, and integration with modern inference systems such as vLLM and SGLang. You'll work onsite in San Jose, collaborating closely with a team of engineers building highperformance GPUaccelerated systems.
  • Develop and optimize CUDA/ROCm kernels for AI workloads
  • Work with HBM, memory hierarchy, thread scheduling, and P2P communication
  • Integrate GPU kernels with vLLM, SGLang, and other inference servers
  • Build highperformance components in C++ and Python
  • Support AI frameworks such as PyTorch and TensorFlow
  • Optimize multiGPU scaling, KVcache, and attention kernels
  • Profile and debug GPU workloads using Nsight, rocprof, etc.
  • Collaborate with crossfunctional GPU, AI, and semiconductor teams
Required Skills:
  • Strong experience with CUDA, ROCm/HIP, OpenCL, or MPI
  • Deep understanding of GPU architecture, HBM, memory models, and thread hierarchies
  • Handson experience with AMD/NVIDIA GPU software stacks
  • Expertlevel C++ and Python
  • Experience with PyTorch or TensorFlow
  • Experience with vLLM, SGLang, or similar inference systems
Preferred Skills:
  • RDMA, RoCE, InfiniBand, or Infinity Fabric
  • Distributed inference/training or HPC experience
  • Semiconductor or hardwareadjacent experience
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10271950
  • Position Id: 8923713
  • Posted 30+ days ago
Contact the job poster
Saurabh Johari

Saurabh Johari

Sr. IT Recruiter @ Triune Infomatics Inc
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Santa Clara, California

Today

Full-time

USD 178,500.00 per year

Sunnyvale, California

Today

Full-time

USD 128,700.00 - 261,300.00 per year

San Jose, California

Today

Full-time

USD 150,500.00 per year

San Jose, California

25d ago

Easy Apply

Contract

$65 - $70

Search all similar jobs