Looking for AI operations platform consultant in Jersey City, NJ(hybrid)- W2

  • Jersey City, NJ
  • Posted 4 days ago | Updated 4 days ago

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)
Able to Provide Sponsorship

Skills

LLM a
Kubernetes
AI operations
AI Operations Platform

Job Details

Position title: AI operations platform consultant

Location: jersey City, NJ

Onsite: 3 days a week

Contract: 6 months extendable

Interview process: 2 video interviews to hire (they might want to onsite)

Must have: LLM and Kubernetes

Kindly share your updated resume to


Project Tasks:
AI Operations Platform Consultant
Experience deploying, managing, operating, and troubleshooting containerized services at scale on Kubernetes for mission-critical applications (OpenShift)
Experience with deploying, configuring, and tuning LLMs using TensorRT-LLM and Triton Inference server.
Managing MLOps/LLMOps pipelines, using TensorRT-LLM and Triton Inference server to deploy inference services in production
Setup and operation of AI inference service monitoring for performance and availability.
Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.
Operation and support of MLOps/LLMOps pipelines, using TensorRT-LLM and Triton Inference server to deploy inference services in production
Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.
Experience with standard processes for operation of a mission critical system incident management, change management, event management, etc.
Managing scalable infrastructure for deploying and managing LLMs
Deploying models in production environments, including containerization, microservices, and API design
Triton Inference Server, including its architecture, configuration, and deployment.
Model Optimization techniques using Triton with TRTLLM
Model optimization techniques, including pruning, quantization, and knowledge distillation

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.