Apply Now

On-prem Platform Engineer

Brevard, NC, US • Posted 3 days ago • Updated 3 days ago

Contract Independent

Contract W2

Contract Corp To Corp

Able to Sponsor

On-site

Depends on Experience

Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

Artificial Intelligence
Grafana
Kubernetes
Generative Artificial Intelligence (AI)
Machine Learning (ML)
GPU
CUDA

Summary

Role: On-prem Platform Engineer

Location: Brevard, Charlotte, NC (Onsite)

Tech Skills Needed:

vLLM TensorRT LLM Triton Inference Server SGLang Inference Optimization Continuous Batching Speculative Decoding KV Cache / Prefix Caching FP8 / AWQ / GPTQ Tensor Parallelism Kubernetes ML Serving KServe OpenShift AI Helm / Operators GPU Orchestration Run:AI Performance Benchmarking CUDA / NCCL / MIG Prometheus / Grafana ML Observability

GuideLLM, Locust

Responsibilities:

Build, configure, and operate on prem Kubernetes/OpenShift AI platforms for deploying and serving GenAI models and LLM inference workloads.
Design and optimize high performance inference stacks using vLLM, TensorRT LLM, Triton Inference Server, SGLang, and advanced techniques (continuous batching, speculative decoding, KV caching).
Manage GPU orchestration and capacity using Run:AI, MIG, CUDA/NCCL, and tensor parallelism to maximize utilization and throughput.
Deploy and operate Kubernetes ML serving frameworks (KServe, Helm, Operators) for scalable, reliable model serving.
Drive inference optimization and benchmarking, leveraging FP8, AWQ, GPTQ, and performance tools such as GuideLLM and Locust.
Implement observability and ML monitoring using Prometheus, Grafana, Arize AI, ensuring SLA/SLO compliance for GenAI services.
Collaborate with ML and research teams to onboard new models, tune inference performance, and productionize GenAI use cases.

Sunil

Lead Technical Recruiter
Phone:

E-mail:

Linkedin:

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 90962964
Position Id: 8966039
Posted 3 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior AI/ML Architect

Greenville, South Carolina

•

Today

Job Description Summary The Senior AI/ML Architect is a visionary leader responsible for defining and delivering scalable, innovative AI solutions for Gas Power Controls. This role entails architecting systems that leverage advanced AI to solve complex business problems and enable transformative applications. You will lead development of products supporting power producing customers and support enterprise-scale AI initiatives leveraging Bedrock foundational models, Azure OpenAI, Google Gemini, a

Full-time

USD 113,200.00 - 188,800.00 per year

Solution Architect (PowerEdge Rack)

Spartanburg, South Carolina

•

Today

Role: Solution Architect (PowerEdge Rack) Duration: 12 months Location: Spartanburg, South Carolina (100% onsite for the first 6 months) Must have skills PowerEdge Rack/Tower Experience, RHEL and Ubuntu OS, Experience working in a larger server environment. PowerEdge XE server experience - Poweredge XE-series GPU servers and accelerated/HPC environment Strong experience with HPC operations in production environments (scheduling, monitoring, troubleshooting, capacity management). Hands on exper

Easy Apply

Third Party, Contract

$DOE

Google Cloud Platform- Gen AI Engineer

Remote

•

Today

Job Title: Google Cloud Platform Gen AI Engineer (LLMs, OCR) Location: Remote with travel C2H Skills: Must Have: Google Cloud Platform, LLM, OCR, all requiredTech Stack: Google Cloud Platform, Vertex AI, Document AI (OCR), LLMs, Python15+ years of experience in AI/ML, Data Engineering, or Software EngineeringExp: 3+ yrs GenAI engineering; document processing or OCR pipeline expBonus: experience with structured and unstructured data extraction from docsFinancial and Banking exp plus

Easy Apply

Contract

Depends on Experience

AI Solution Architect (Gen AI / ML Platforms)

Remote

•

3d ago

Role OverviewWe are seeking a highly experienced AI Solution Architect to design and deliver enterprise-grade AI/ML and Generative AI solutions at scale. This is a hands-on leadership role focused on building production-ready AI systems, architecting modern GenAI platforms, and enabling engineering teams through robust developer platforms and best practices. You will work at the intersection of AI engineering, platform architecture, and developer experience, driving innovation while ensuring rel

Easy Apply

Contract, Third Party

$80 - $110

Search all similar jobs