Senior AI/ML performance engineer

Key Responsibilities

• Profile and optimize large-scale AI training and inference workloads (transformers, multimodal, diffusion, recommender systems) across multi-node, multi-GPU clusters.
• Build tools, frameworks, to detect and identify bottlenecks in compute, memory, interconnects, and communication libraries and deliver optimizations to maximize scaling efficiency.
• Develop, maintain and recommend benchmarks for AI training and inference workloads.
• Partner with framework teams (PyTorch, TensorFlow) to upstream performance improvements and enable better scaling APIs.
• Collaborate across the engineering organizations to deliver efficiency in our usage of hardware, software, and infrastructure
• Proactively monitor fleet wide utilization patterns, analyze existing inefficiency patterns, or discover new patterns, and deliver scalable solutions to solve them

Required Qualifications

• 5+ years in AI/ML performance engineering, HPC, or large-scale inference systems
• BS or similar background in Computer Science or related area (or equivalent experience)
• Strong understanding and hands-on modern ML techniques and tools
• Strong hands-on CUDA programming and optimization experience
• Deep understanding of GPU architecture and memory hierarchy
• Experience optimizing PyTorch and/or TensorFlow inference
• Hands-on experience with NVIDIA Triton, Apache Ray, and Kubernetes GPU scheduling
• Experience with RAPIDS and GPU-accelerated data pipelines
• Experience in benchmarking methodologies, performance analysis/profiling (e.g. Nsight), performance monitoring tools
• Strong track record of optimizing large-scale AI systems

Nice to Have

• Neural network architecture optimization experience
• Deep TensorRT optimization expertise
• Video analytics or real-time inference systems experience
• Experience operating large-scale GPU clusters Experience with WebAssembly (WASM) for performance-critical frontend computation.
• Advanced Linux OS, container (e.g. Docker) and GitHub skills

Thanks and Regards,

Shiney K

Sr. US IT Recruiter

Prointegrate Inc.

Phone:

Email ID:

New York | London | India

This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient or have received this transmission in error, please contact the sender by reply by email and destroy all copies of the original message. Any unauthorized review, use, copy, dissemination, or disclosure of this email is strictly prohibited.