AI Infrastructure Domain Architect

Remote • Posted 2 hours ago • Updated 2 hours ago
Part Time
No Travel Required
Remote
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • NVIDIA GPU Platforms
  • GPU Infrastructure
  • NVIDIA DGX / HGX
  • GPU Cluster Architecture

Summary

Job description as follows:
JD 1 — AI Infrastructure Domain Architect
Location: United States, remote. Must be US-based. Engagement: Six-month contract-to-hire, with conversion or extension expected.
Role
Designs accelerated-compute infrastructure for enterprise AI build-outs: GPU compute, east-west fabric, storage and the platform software that sits on top. This is a single-domain architect role, not a multi-discipline enterprise architect. Depth in NVIDIA-based infrastructure matters more than breadth across unrelated technology towers.
The architect owns the solution from requirements through to a design an engineering team can build, and remains the technical authority during deployment. They are the one technical voice to the customer on the AI infrastructure stack and the escalation point for the build team.
Responsibilities
    • Translate workload requirements — training, fine-tuning, inference, mixed — into a sized GPU cluster design covering compute, fabric, storage, power and cooling.
    • Produce the design artefacts: high- and low-level design, bill of materials, rack and floor layouts, power and thermal budgets, cable plans, IP and fabric addressing schemes.
    • Select and justify platform: NVIDIA-branded systems versus an NVIDIA-partnered OEM build, with the trade-offs stated in writing.
    • Design the east-west fabric and defend the choice between InfiniBand and Spectrum-X Ethernet for the given workload.
    • Design the storage tier against real throughput and checkpointing requirements rather than capacity alone.
    • Define the acceptance criteria and test plan the deployment team will execute, and sign off the results.
    • Write the methods of procedure the engineering team works to, and review their deployment documentation.
    • Act as technical escalation during build; resolve design issues without stopping the programme.
    • Work alongside the customer's and the integrator's own architects, including where the integrator's team is being skilled up in parallel.
Required technical experience
Platform — at least one, ideally more than one:
    • NVIDIA DGX or HGX platforms (B300, B200, H200, GB200, GB300 or prior generations).
    • Dell GPU server platforms with NVIDIA GPUs.
    • HPE GPU server platforms with NVIDIA GPUs.
Experience on another HPC stack is additive, not a substitute. Candidates from IBM, Cray or similar HPC backgrounds are in scope provided NVIDIA GPU infrastructure is also in their history.
Reference architectures: NVIDIA DGX BasePOD and DGX SuperPOD, or the NVIDIA Enterprise Reference Architectures. Must be able to explain where a design departs from the reference and why.
Fabric: NVIDIA Quantum InfiniBand and/or Spectrum-X Ethernet. RDMA, RoCE, rail-optimised topologies, congestion control. BlueField DPUs and DOCA, and SuperNIC-class adapters.
Storage: High-throughput parallel storage for AI — any of DDN, WEKA, VAST, Pure or equivalent — sized against GB/s per GPU rather than terabytes.
Platform software: NVIDIA Base Command Manager, DGX OS, GPU drivers and CUDA, NVIDIA GPU Operator, container toolkit and NGC. Working knowledge of Slurm and Kubernetes as scheduling layers, including when each is appropriate.
Facilities literacy: Rack power density, liquid and air cooling implications, and the practical limits a data hall imposes on a design.
Experience and credentials
    • 8–12 years in enterprise infrastructure architecture, of which at least 3 years on GPU, HPC or accelerated-compute infrastructure.
    • Demonstrable delivery of at least one multi-node GPU cluster from design through to acceptance. Node count, GPU model, fabric and the candidate's specific role must be stated.
    • Customer-facing experience: able to present and defend a design to a customer's technical leadership.
    • Strong technical writing. Design documents are a deliverable on these engagements, not a by-product.
Certifications — preferred, not mandatory:
    • NVIDIA-Certified Professional: AI Infrastructure (NCP-AII)
    • NVIDIA-Certified Professional: AI Networking (NCP-AIN)
    • NVIDIA DGX platform or InfiniBand training paths
TOGAF, Zachman and similar enterprise-architecture frameworks are not required for this role. They are required for WWT's Enterprise Architect positions, which are a different requirement.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91135325
  • Position Id: 9142426
  • Posted 2 hours ago

Company Info

About InOptra Digital Innovations Inc.

INOPTRA | Intelligent. Optimized. Transformative.

At INOPTRA, we blend intelligence and innovation to shape the future of global technology. As an AI-led enterprise, we specialize in delivering high-impact, future-ready solutions that empower our clients to navigate complex digital transformations and lead in engineering innovation.

Our offerings & proven solutions provide a unique competitive advantage for our clients by giving them the power of performance, quality, agility, and resourcefulness. We bring decades of experience in developing Global Capability Centers / High-Value Engineering Centers for our clients in the USA, Europe, and APAC, covering the spectrum of skills including Data Engineering and Analytics, Digital Infrastructure & Cybersecurity, Embedded & IoT, Digital Applications, Product and Plant Engineering. 

Our approach is guided by one unwavering principle: “Partner only when you can deliver substantial value.” This ethos ensures that every engagement is grounded in trust, performance, and measurable business outcomes.

At our core, we are relentless about fusing technological prowess with human intelligence—because that’s where true transformation begins. INOPTRA is your strategic ally for global acceleration, operational excellence, and sustained growth.

Your vision, Engineered Smarter >> www.inoptra.com

About_Company_OneAbout_Company_Two
Contact the job poster
SB

Shravani Bagari

Recruiter @ InOptra Digital Innovations Inc.

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.