Sr. Engineer - AI Evaluation & Reliability

Overview

Hybrid
65 - 75
Contract - Independent
Contract - W2
Contract - 6 Month(s)
No Travel Required
Unable to Provide Sponsorship

Skills

Artificial Intelligence
Product Requirements
Streaming
Test Plans
Communication
Evaluation
Machine Learning (ML)
Python
Testing
Workflow

Job Details

Job Description -

Need locals and no 3rd party candidates

Sr. Engineer - AI Evaluation & Reliability ( W2 ) 
Hybrid - Redwood City, CA
Skype

JD

•    6+ years building evaluation or testing infrastructure for ML/LLM systems or large-scale distributes system
•    Proven ability to translate product requirements into measurable metrics and test plans.
•    Strong Python skills
•    Strong Experience with modern data tooling
•    Hands-on experience running A/B tests, canaries, or experiment frameworks.
•    Experience defining and maintaining operational reliability metrics (SLIs/SLOs) for AI-driven systems.
•    Familiarity with large-scale distributed or streaming systems serving AI/agent workflows (millions of events or alerts/day).
•    Excellent communication skills -- able to clearly convey technical results and 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Tek Inspirations LLC