PRIMUS Global Services Inc.
PRIMUS Global Services Inc.

Senior AI/ML Ops Engineer Agent Evaluation, Observability & Production Reliability, Onsite - 69753

Austin, TX, US • Posted 6 hours ago • Updated 2 hours ago
Contract W2
Travel Required
On-site
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • MLOPS
  • ML Engineering
  • AI Ops
  • LLM Ops
  • LLM Evaluation

Summary

Senior AI/ML Ops Engineer Agent Evaluation, Observability & Production Reliability, Onsite

We have an immediate need for an experienced Senior AI/ML Ops Engineer with strong expertise in LLM evaluation, MLOps, agent observability, production reliability, and AI platform engineering to build and operate the evaluation and reliability backbone for production AI agents.

This is an onsite position based in Austin, TX or Sunnyvale, CA for a candidate with deep experience in Python, LLMs, LLM-powered applications, AI Agent Evaluation, Golden Datasets, LLM-as-Judge, Regression Testing, CI/CD, GitHub Actions, GitLab CI, Jenkins, OpenTelemetry, Datadog, Grafana, Prometheus, LangSmith, Langfuse, Arize Phoenix, Braintrust, and W&B Weave. Experience with Agentic AI, Multi-Agent Systems, Tool Use, RAG Pipelines, Prompt Management, Model Routing, Fine-Tuning Workflows, A/B Testing, Causal Inference, Knowledge Graphs, and AI Observability will be highly valued.

For immediate consideration, please contact:
Pankaj
PRIMUS Global Services
Phone: Desk Ext. 214
Email:

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10117354
  • Position Id: 2026-68447
  • Posted 6 hours ago

Company Info

About PRIMUS Global Services Inc.

At PRIMUS we bring together the right people, knowledge, methodology, and technologies you require for the project at hand.

Whether you require staff augmentation, strategy consulting, technology integration (offsite or onsite, time and materials or fixed bid projects) or offshore development solutions -PRIMUS can get the job done.

We provide the right solution for your company, be it recruiting the exact person or team to work directly for you, or outsourcing the entire project to PRIMUS. We develop customized solutions that exceed our client s expectations and we do it on time and on budget.

PRIMUS provides cost-effective solutions. Because we have consultants in almost every industry - telecommunications, financial, healthcare, security, transportation, consulting, logistics, high-tech, oil and gas, government and hospitality - we can assure you that we will assign a team to your project that understands your industry and your needs and can help you stay competitive in the digital economy.

About_Company_One
Go to company profile
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

AI Engineer, Onsite - 69735

Charlotte, North Carolina

•

Today

Easy Apply

Contract

AI Solution Delivery, Hybrid - 69755

Cupertino, California

•

Today

Easy Apply

Contract

Search all similar jobs
More jobs at PRIMUS Global Services Inc. in Austin, TX