Solution Architect

Role:Solution Architect

Duration : 13 Months

Location: Spartanburg, South Carolina (100% onsite for the first 6 months)

Must have skills
Strong experience with HPC operations in production environments (scheduling, monitoring, troubleshooting, capacity management).
Hands on expertise with NVIDIA GPU infrastructure (preferably GB200/GB300 class racks, H100/B100 or similar generations) including firmware/driver stack, monitoring, and lifecycle management.
Familiarity with liquid cooled data center infrastructure: working safely around cold plate / rear door heat exchanger systems, understanding facility interfaces (CDU, manifolds, leak detection, etc.).
Solid understanding of Linux administration (RHEL/CentOS/Ubuntu) in HPC/AI clusters: OS provisioning, patching, performance tuning, and troubleshooting.
Experience with cluster management tools (e.g., Bright, OpenHPC, Slurm, PBS/LSF, Kubernetes based AI stacks, or equivalent schedulers and orchestration frameworks).
Strong Day 2 operations mindset: incident response, root-cause analysis, change management, and operational runbook creation.
Excellent customer facing communication skills and the ability to work on site, embedded with the customer's team and their operations staff.

Nice to have skills
Prior experience operating or supporting Dell XE/XE HPC & AI solutions and related management tooling.
Background in HP/HPE HPC environments (familiar with how HP is typically deployed/managed in HPC shops, to ease comparison and migration).
Exposure to AI/ML and GenAI workloads running at scale on NVIDIA GPU infrastructure (MLOps pipelines, model training/inference operations).
Experience with data center facilities coordination (power and cooling planning, rack integration, cabling standards, change windows).
Scripting skills in Python/Bash/PowerShell for automation, reporting, and integration with monitoring/ITSM systems.
Familiarity with ITIL aligned processes (incident, problem, and change management) and documenting runbooks/SOPs.
Strong scripting/automation skills, especially in Python and Bash, for automating operational workflows, health checks, and reporting across large GPU clusters.
Experience building or maintaining infrastructure automation (e.g., Ansible, Terraform, or similar) for repeatable deployment, configuration, and lifecycle management of HPC/AI nodes.
Some scripting skills in Python/Bash/PowerShell for automation, reporting, and integration with monitoring/ITSM systems.
Experience with DevOps / Git based workflows (GitLab/GitHub, CI/CD) to help with scripts, automation playbooks, and configuration as code.


Detailed Project Tasks / Scope
The resident will be a full time, on site operational resource focused on Day 2 operations for liquid cooled Dell XE racks with NVIDIA GB300 based configurations. Scope includes, but is not limited to:

Day 2 operations & stability
Own day to day operational support for the initial 48 fully loaded GB300 racks, scaling to grow toward 144 racks by year end.
Monitor system health, performance, and capacity; proactively identify and remediate issues impacting uptime or SLAs.
Perform incident triage, troubleshooting, and coordination with Dell and NVIDIA support as needed.

Infrastructure management
Support rack level and node level lifecycle tasks: firmware/driver updates, BIOS tuning, OS patching, and configuration consistency.
Assist with liquid cooling operations: safe work practices, coordination with facilities for maintenance/change activity, and monitoring of cooling performance and alarms.
Validate and maintain power, cooling, and space documentation as the environment scales from 48 to 144 racks.

HPC/AI platform operations
Support cluster scheduler / workload manager operations (job queues, resource pools, and performance tuning) in the context of GPU heavy workloads.
Work with to ensure that AI/HPC workloads are efficiently utilizing the GB300 i