Evaluation jobs in Colorado

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

Remote Quality Analyst - US

Remote

•

Today

About Turing: Turing is one of the worlds fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the worlds leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies. Role Overview: We are lo

Easy Apply

Contract

30 - 40

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

CER // Medical Writer

Remote

•

Yesterday

Job Title - Medical Writer 2 ( Location: Remote Hours: Part time. upto 30hours Reports to: Manager, Medical Science. Joining client means joining a team dedicated to using technology to benefit patients by improving surgical efficacy and decreasing surgical invasiveness, with patient safety as our highest priority. Primary Function of Position: This position reports to Manager, Medical Science and requires a strong candidate with experience in medical writing of clinical regulatory documents.

Easy Apply

Contract

52 - 61

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Remote Business Analyst - US

Remote

•

Today

Easy Apply

Contract

15 - 20

Remote Business Analyst - US

Remote

•

Today

Easy Apply

Contract

15 - 20

Lead AI Engineer/Developer

Remote

•

7d ago

Role SummaryThe AI Engineer/Developer is a senior technical professional responsible for designing, deploying, governing, and optimizing enterprise AI solutions within secure and regulated environments. This role focuses on Azure AI technologies, Microsoft ecosystem integrations, agentic AI solutions, and responsible AI practices. The position collaborates with technical and business stakeholders to develop scalable AI capabilities while supporting security, privacy, governance, and operational

Easy Apply

Contract, Third Party

Depends on Experience

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Junior Sustainment Test and Evaluation Engineer

Colorado Springs, Colorado

•

Today

nLogic is seeking a Junior Sustainment Test and Evaluation Engineer to support a MILSATCOM Program Management Office (PMO) within the US Space Force's (USSF), Space Systems Command (SSC) at Peterson Space Force Base (PSFB), CO. We are looking for an innovative, creative, and highly motivated individual to conduct test and evaluation activities and terminal operations for a diverse portfolio of strategic and tactical Military Satellite Communications (MILSATCOM) and Nuclear, Command, Control & Co

Full-time

USD 70,000.00 - 100,000.00 per year

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Engineer-In-Training II, Construction - Grand Junction

Grand Junction, Colorado

•

Today

Salary: $73,200.00 - $80,628.00 Annually Location : Grand Junction, CO Job Type: Full Time Job Number: HAA-50004468-10/26 Department: Department of Transportation Division: CDOT Region 3 Opening Date: 10/19/2026 Closing Date: 11/1/2026 11:59 PM Mountain FLSA: Determined by Position Type of Announcement: This position is open only to Colorado state residents. Primary Physical Work Address: 606 S 9th St, Grand Junction, CO 81501, USA FLSA Status: Non-Exempt; position is eligible for overtime compe

Full-time

USD 73,200.00 - 80,628.00 per year

Engineer-In-Training II, Hydraulics - Eagle

Colorado

•

Today

Salary: $73,200.00 - $80,628.00 Annually Location : Eagle County, CO Job Type: Full Time Job Number: HAA-50003553-09/26 Department: Department of Transportation Division: CDOT Region 3 Opening Date: 09/14/2026 Closing Date: 10/25/2026 11:59 PM Mountain FLSA: Determined by Position Type of Announcement: This position is open only to Colorado state residents. Primary Physical Work Address: 714 Grand Ave, Eagle, CO 81631, USA FLSA Status: Non-Exempt; position is eligible for overtime compensation.

Full-time

USD 73,200.00 - 80,628.00 per year

Senior Agentic AI Engineer/ Generative AI Engineer/ Applied AI Engineer/ AI Application Engineer / LLM Engineer / Senior AI Software Engineer

Remote

•

Today

We re Hiring: Senior Agentic AI Developer Locations: Remote Experience: 10+ Years | 2+ Years in LLM Applications or equivalent demonstrable experience We are looking for a hands-on Senior Agentic AI Developer to build, integrate, and deploy production-ready AI applications. Mandatory Skills: Python & SQL Agentic AI & LLM Application Development RAG Pipeline Development Microsoft Azure Production AI Application Deployment Good to Have: Databricks & API Integration AI Evaluation, Testing

Easy Apply

Contract, Third Party

$70 - $90

Medical Experts - Dermatology (USA)

Remote

•

22d ago

Job Title: Medical Experts - Dermatology (USA) Experience: 5 Years to 5 Years Job Type: Remote Location: N/A Openings: 40 Currency: USD Visa: // H1B / EAD Driver's License: Required Valid US DL Job Description: Years of Experience: A minimum of 5 years of post-residency experience practising as a dermatologist About Turing: Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced

Easy Apply

Contract

Depends on Experience

Forward Deployed Engineer | Remote | Texas

Remote

•

Today

Applicants must be currently authorized to work in the US on a full-time basis now and in the future. Job Description We are building a team of Forward Deployed Engineers for a fintech organization. This is an opportunity to work near the cutting edge of AI business use-cases that are already providing value to real users & customers. In this position you will be collaborating closely with both internal & customer teams to integrate, customize, and deploy AI solutions in customer environments.

Easy Apply

Full-time

$140000 - $210000

Evaluation jobs in Colorado, USA