AI Evaluation & Model Risk Lead

Bellevue, WA, US • Posted 3 days ago • Updated 3 days ago
Contract W2
Contract Independent
18 Months
Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • AI Evaluation
  • Model Risk
  • Claude
  • OpenAI
  • Glean
  • Python

Summary

 

Title: AI Evaluation & Model Risk Lead

Location: Bellevue WA

Job Responsibilities

  • Own initial model-risk clearance and the approved-use rating that gates a model into use.
  • Own ongoing evaluation — re-clear on version changes, evaluate against live traffic, and catch drift.
  • Author and own the model cards as the durable record of what was tested and what each model is cleared for.
  • Build and run the evaluation harness and test suites to the bar Safety Standards sets, with Cyber owning security red-teaming.
  • Collaborate with cross-functional teams to ensure effective integration and functionality of AI systems
  • Also responsible for other duties/projects as assigned by business management as needed

Education and Work Experience

  • Bachelor's Degree plus 3 years of related work experience
  • OR advanced degree with 1 year of related work experience
  • OR a combination of education and experience deemed equivalent (Required)
  • Acceptable areas of study include Computer Science, Engineering, Artificial Intelligence, Data Science, or a Related Field (Preferred)
  • 2-4+ years Developing and deploying machine learning models, including fine-tuning and prompt engineering (Preferred)
  • 2-4+ years Experience with AI tools and software development using programming languages such as Python or R (Preferred)
  • 2-4+ years Collaborating with cross-functional teams to integrate AI solutions into business workflows (Preferred)

Required Knowledge, Skills and Abilities

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90956948
  • Position Id: 10000006009/23716-1
  • Posted 3 days ago
Contact the job poster
KS

Kamaal Syed

Recruiter @ WB Solutions LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Bellevue, Washington

4d ago

Easy Apply

Third Party, Contract

Depends on Experience

Seattle, Washington

Today

Full-time

USD 146,830.00 - 192,720.00 per year

Seattle, Washington

Today

Full-time

USD 184,030.00 - 275,400.00 per year

Tacoma, Washington

Today

Full-time

USD 185,000.00 - 230,000.00 per year

Search all similar jobs