AI Infrastructure Deployment Engineer

Hybrid in Union City, CA, US • Posted 1 day ago • Updated 1 day ago
Contract W2
6 Months
50% Travel Required
Hybrid
$20 - $80/hr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • NVIDIA GPU Servers & GPU Hardware
  • Data Center Infrastructure – Rack & Stack
  • GPU Cluster Deployment & Configuration
  • Linux Administration
  • NVIDIA Base Command Manager (BCM)
  • Slurm
  • Enroot & Pyxis
  • InfiniBand / Spectrum-X Ethernet
  • RoCE
  • ECN & PFC
  • BMC & Out-of-Band Management
  • Firmware & BIOS Configuration
  • GPU
  • NIC
  • DPU & Switch Configuration
  • NVIDIA GPU Drivers & DOCA
  • NCCL
  • HPL & ClusterKit
  • NVLink & NVLink Switch
  • UFM Monitoring & Troubleshooting
  • Storage Performance & Throughput Testing
  • GPU Cluster Stress Testing & Burn-in

Summary

 AI Infrastructure Deployment Engineer
Location: United States. Must be US-based and willing to work on customer sites.
Role
Builds what the architect designed, and proves it works. Hands-on from rack and stack through to signed-off acceptance: physical installation, firmware and out-of-band configuration, fabric bring-up, cluster software install, and the validation and burn-in that demonstrates the cluster performs to specification.
This is a build-and-prove role. The validation half matters as much as the installation half, because an OEM-branded GPU build does not come with a ready-made acceptance suite — NVIDIA certification validates server models and configurations, not the cluster standing on a customer floor. The engineer runs and, where needed, assembles that acceptance testing.
Responsibilities
Physical build
    • Install GPU servers and GPUs; verify seating, airflow and serviceability.
    • Identify and validate cables and transceivers across the compute, storage and management fabrics; confirm signal quality before handover.
    • Confirm power and cooling parameters against the design, and escalate where the data hall will not support it.
Bring-up and configuration
    • Configure BMC and out-of-band management; set up TPM where required.
    • Apply and verify firmware across GPU baseboards, NICs, switches, DPUs and transceivers; interpret and act on fault detection output.
    • Install and configure the control plane: NVIDIA Base Command Manager including high-availability head nodes, operating system and cluster components, Slurm with Enroot and Pyxis, GPU and DOCA drivers, container toolkit and NCLI.
    • Set initial parameters for third-party storage and confirm throughput against the design.
Fabric
    • InfiniBand: provisioning, high availability, partition keys for multi-tenancy, quality of service, adaptive routing, and link and bandwidth monitoring through UFM.
    • Or Spectrum-X Ethernet: RoCE, ECN and PFC configuration, quality of service, adaptive routing, telemetry.
    • Troubleshoot with the standard tooling — ibdiagnet, iblinkinfo, ib_write_lat and ib_write_bw, ibping, What Just Happened, UFM health.
Validation and acceptance — the half that is usually missing
    • Single-node stress and burn-in.
    • HPL and single-node NCCL, including NVLink and NVLink Switch verification.
    • ClusterKit node assessment to find the weak node before the customer does.
    • NCCL east-west fabric bandwidth tests across the cluster.
    • Sustained burn-in using NCCL, HPL and NeMo workloads.
    • Storage throughput testing under realistic checkpoint load.
    • Produce the acceptance report: what was tested, what it returned, what was remediated.
Operate and remediate
    • Diagnose and replace failed GPUs, network cards, fans and power supplies.
    • Tune storage and fabric where results fall short of specification.
    • Hand over to the customer or operations team with documentation that matches what was actually built.
Experience and credentials
    • 5–8 years in data centre infrastructure engineering, of which at least 2–3 years hands-on with NVIDIA GPU hardware. This matches NVIDIA's own stated prerequisite for its AI infrastructure certification.
    • Delivered at least one multi-node GPU cluster build. Node count, GPU model, fabric type and the candidate's own scope must be stated, not implied.
    • Comfortable on a customer site, under programme pressure, working to someone else's design and method of procedure.
    • Linux systems fluency; scripting for repeatable build steps.
Certifications — strongly preferred:
    • NVIDIA-Certified Professional: AI Infrastructure (NCP-AII)
    • NVIDIA-Certified Professional: AI Networking (NCP-AIN) for fabric-leaning candidates
What takes a candidate out of scope
    • Remote-only or lab-only experience. This work happens on site.
    • Data scientists, ML engineers and MLOps specialists.
    • Pure network engineers with no server, GPU or firmware exposure, unless hired explicitly against the fabric specialism.
    • Candidates who cannot name the clusters they built and what they personally did on them.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91135325
  • Position Id: AIID01
  • Posted 1 day ago

Company Info

About InOptra Digital Innovations Inc.

INOPTRA | Intelligent. Optimized. Transformative.

At INOPTRA, we blend intelligence and innovation to shape the future of global technology. As an AI-led enterprise, we specialize in delivering high-impact, future-ready solutions that empower our clients to navigate complex digital transformations and lead in engineering innovation.

Our offerings & proven solutions provide a unique competitive advantage for our clients by giving them the power of performance, quality, agility, and resourcefulness. We bring decades of experience in developing Global Capability Centers / High-Value Engineering Centers for our clients in the USA, Europe, and APAC, covering the spectrum of skills including Data Engineering and Analytics, Digital Infrastructure & Cybersecurity, Embedded & IoT, Digital Applications, Product and Plant Engineering. 

Our approach is guided by one unwavering principle: “Partner only when you can deliver substantial value.” This ethos ensures that every engagement is grounded in trust, performance, and measurable business outcomes.

At our core, we are relentless about fusing technological prowess with human intelligence—because that’s where true transformation begins. INOPTRA is your strategic ally for global acceleration, operational excellence, and sustained growth.

Your vision, Engineered Smarter >> www.inoptra.com

About_Company_OneAbout_Company_Two
Contact the job poster
RR

Raj Rao

Recruiter @ InOptra Digital Innovations Inc.

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.