Triune Infomatics Inc
Triune Infomatics Inc

GPU Software Engineer/GPU Architect

San Jose, CA, US • Posted 2 days ago • Updated 15 hours ago
Contract W2
No Travel Required
On-site
$100+
Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Job Details

Skills

  • C++
  • CUDA
  • GPU
  • Remote Direct Memory Access
  • PyTorch
  • OpenCL
  • Artificial Intelligence

Summary

Role: GPU Software Engineer/GPU Architect
Location: San Jose, CA
Duration: Long-term >> ongoing contract
 
Overview: We're looking for a strong GPU Software Engineer/GPU Architect to join a highimpact engineering team working on nextgeneration AI, GPU, and semiconductor technologies. This role focuses on GPU kernel development, memory architecture, and integration with modern inference systems such as vLLM and SGLang. You'll work onsite in San Jose, collaborating closely with a team of engineers building highperformance GPUaccelerated systems.
  • Develop and optimize CUDA/ROCm kernels for AI workloads
  • Work with HBM, memory hierarchy, thread scheduling, and P2P communication
  • Integrate GPU kernels with vLLM, SGLang, and other inference servers
  • Build highperformance components in C++ and Python
  • Support AI frameworks such as PyTorch and TensorFlow
  • Optimize multiGPU scaling, KVcache, and attention kernels
  • Profile and debug GPU workloads using Nsight, rocprof, etc.
  • Collaborate with crossfunctional GPU, AI, and semiconductor teams
Required Skills:
  • Strong experience with CUDA, ROCm/HIP, OpenCL, or MPI
  • Deep understanding of GPU architecture, HBM, memory models, and thread hierarchies
  • Handson experience with AMD/NVIDIA GPU software stacks
  • Expertlevel C++ and Python
  • Experience with PyTorch or TensorFlow
  • Experience with vLLM, SGLang, or similar inference systems
Preferred Skills:
  • RDMA, RoCE, InfiniBand, or Infinity Fabric
  • Distributed inference/training or HPC experience
  • Semiconductor or hardwareadjacent experience
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10271950
  • Position Id: 8923713
  • Posted 2 days ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Principal GPU Performance Engineer - Artificial Intelligence

Santa Clara, California

•

Today

Full-time

USD 198,100.00 per year

Staff Software Development Engineer- GPU, LLM, AI

Santa Clara, California

•

Today

Full-time

USD 120,750.00 per year

Principal Software Development Eng. - AI Performance

San Jose, California

•

Today

Full-time

USD 198,100.00 per year

Staff Software Developer- AI Frameworks, GPU Optimization

San Jose, California

•

Today

Full-time

USD 142,940.00 per year

Search all similar jobs