AI Automation engineer

Bellevue, WA, US • Posted 12 hours ago • Updated 12 hours ago
Full Time
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • AI
  • Automation
  • ETL
  • Python
  • SQl.
  • RAG
  • API

Summary

AI Automation engineer
Onsite role in Bellevue, Wasington.
Fulltime position.
Total 15+ exp
 
Must have skills
ETL Pipeline
ML /AI 
AI Ops (ML Ops, Agent Ops & LLM Ops) Workflow
Python , SQL
System Design,
MCP Client server design
 
Job description:
 
 Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.
• Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
• Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.
• Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: RTX17ee7d
  • Position Id: 1308-33630-1786024803
  • Posted 12 hours ago
Contact the job poster
BU

Batch User

Recruiter @ SoftPath Technologies LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Seattle, Washington

Today

Full-time

USD 202,160.00 - 368,220.00 per year

Seattle, Washington

Today

Full-time

USD 148,200.00 - 300,960.00 per year

Remote

Today

Easy Apply

Contract

$80 - $90

No location provided

Today

Full-time

Search all similar jobs