LLM Inference / AI Infrastructure Engineer

Job Title: LLM Inference & GPU Systems Consultant Location: Charlotte-NC Local candidates only Duration: Long Term Must have : RunAI /LLM Inference & GPU / vLLM and TensorRT-LLM. Required Skills & Experience Required Qualifications 8+ years experience working as an LLM Systems Engineer or AI Infrastructure Runtime Engineer. 8+ years hands-on experience with NVIDIA H200 clusters and runtime optimization techniques (KV Cache, prefill/decode). Proficiency in OpenShift AI and GPU orchestration tool

Role : LLM Inference & GPU Systems Consultant Location : Charlotte , NC ( Locals only) We are seeking an AI Infrastructure Runtime Engineer to build and maintain large-scale on-prem LLM infrastructure. This is an enterprise private GenAI environment running on NVIDIA H200 GPU clusters and an OpenShift AI deployment ecosystem. You will manage production inference internally, including self-hosting open-source LLMs like Llama. We are focused exclusively on inferencing; this role involves no model

TECHNOGEN, Inc. is a Proven Leader in providing full IT Services, Software Development and Solutions for 15 years. TECHNOGEN is a Small & Woman Owned Minority Business with GSA Advantage Certification. We have offices in VA; MD & Offshore development centers in India. We have successfully executed 100+ projects for clients ranging from small business and non-profits to Fortune 50 companies and federal, state and local agencies. Description: Local candidates preferred. Role Overview: We are se

Job Title: Cloud Infrastructure Engineer Location: Charlotte, NC (5 Days onsite) Duration: 12+ months Primary Skills vLLM TensorRT-LLM Triton Inference Server SGLang Kubernetes ML Serving KServe OpenShift AI GPU Orchestration Google Cloud Platform Terraform Nvidia Key Responsibilities Design and manage scalable AI/ML infrastructure for GenAI and LLM workloads. Deploy and optimize LLM inference pipelines using vLLM, TensorRT-LLM, Triton Inference Server, and SGLang. Implement inference optimi