Evaluation jobs in Belmont, CA

Hybrid in Palo Alto, California

•

Today

PART TIME -12 hrs per week Description: Purpose of the role: The Program Coordinator will provide coordination for the TPAR (Training Program in Aging Research) NIH T32 institutional training program. The role supports program operations, governance meetings, trainee and mentor tracking, seminar logistics, data collection, documentation, evaluation support, and NIH progress report preparation. The coordinator provides the administrative infrastructure by ensuring that program records, trainee o

Easy Apply

Contract

$40 - $45

Senior ML / Evaluation Engineer

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

AI Product Manager

Sunnyvale, California

•

Today

Role: Product Manager for AI Solution Location: Sunnyvale, CA Who are we? For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. What are we looking? Overview: The Product Manager for AI Solutions drives execution across the Client ecosystem. This role sits at the intersection of business strategy and deep AI technical capa

Easy Apply

Full-time

$90,000 - $170,000

Software Engineer AI Evaluation & Automation

Santa Clara, California

•

9d ago

Tittle Software Engineer AI Evaluation & Automation Location- San Diego, CA / Santa Clara, CA (Locals only) Contract 6 - 12 months Department is currently involved in creating automation testing tools to test large datasets. Need candidates local to San Diego, CA or Santa Clara, CA as the team is based in those locations. They are looking for candidates with AI evaluation automationexperience. Must-Have experience with Python or Javascript. They must have experience using existing AI tools w

Easy Apply

Contract

Depends on Experience

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

Software eng requirement

Sunnyvale, California

•

2d ago

We have an urgent, brand-new requirement for a **Simulation CV/ML Engineer** supporting an exciting engagement with Meta in **Sunnyvale, CA** (3 days onsite per week). **Position Details:** * **Role:** Simulation CV/ML Engineer * **Location:** Sunnyvale, CA (3 days onsite / hybrid) * **Employment Type:** Contract via **Infosys W2 (Mandatory Infy W2 payroll from Day 1)** * **Work Authorization:** Visa independent candidates are welcome (**OPT, , and s** are all eligible). **Key Responsibil

Easy Apply

Full-time

50 - 55

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

AI Software Engineer

Sunnyvale, California

•

7d ago

AI Software EngineerSunnyvale, CA Who are we? For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check. What are we looking?Overview: The AI Software Engineer is responsible for the technical backbone of our autonomous tools. This role bridges software engineering, API integrat

Easy Apply

Full-time

Depends on Experience

Product Manager - AI

Sunnyvale, California

•

6d ago

Product Manager for AI Solution Sunnyvale, CA Who are we? For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check; What are we looking? Overview: The Product Manager for AI Solutions drives execution across the Clover ecosystem. This role sits at the intersection of business

Easy Apply

Full-time

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer, Simulation & Evaluation

Alameda, California

•

Today

THE COMPANY Saildrone is a maritime defense company and the global leader in autonomous unmanned surface vehicles (USVs). With more ocean miles and real-world operational experience than any USV manufacturer or operator, Saildrone maintains active, combat-deployed systems supporting national security and force projection around the world, 24/7/365. Saildrone's manufacturing and R&D headquarters are located in Alameda, CA, with business development and sales operations in Washington, DC, and dep

Full-time

USD 144,500.00 - 300,000.00 per year

Senior Software Systems Engineer, Autonomous Vehicles - Metrics & Evaluation

Sunnyvale, California

•

Today

Job Description The Role You will be part of a team that drives systematic and data-driven improvements to the Autonomous Vehicle software by designing, implementing, and maintaining robust processes for evaluation and validation of our AVs. To achieve this objective, we are looking for a highly motivated individual with excellent analytical skills to own end to end execution, methodology improvements and insight articulation/communication to ensure high-quality evaluation and release of our En

Full-time

USD 153,200.00 - 234,100.00 per year

Senior Software Engineer - ML Tooling and Evaluation

Sunnyvale, California

•

Today

Job Description About the Team The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation. Why Join Us? Develop introspection and evaluation tools capable of processing billions of examples to extract maximum value from our large-scale datasets. Join a high-impact t

Full-time

USD 144,700.00 - 261,300.00 per year

AI Evaluation Infrastructure Engineer

San Francisco, California

•

20d ago

It all started with an idea at Block in 2013. Initially built to take the pain out of peer-to-peer payments, Cash App has gone from a simple product with a single purpose to a dynamic ecosystem, developing unique financial products, including Afterpay/Clearpay, to provide a better way to send, spend, invest, borrow and save to our 50+ million monthly active customers. We want to redefine the world's relationship with money to make it more relatable, instantly available, and universally accessibl

Full-time

USD 263,600.00 - 395,400.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Applied AI Researcher, Agent Systems & Evaluation

Mountain View, California

•

Today

Who We Are Nuro is a self-driving technology company on a mission to make autonomy accessible to all. Founded in 2016, Nuro is building the world's most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core technology, the Nuro Driver , to support a wide range of applications, from robotaxis and commercial fleets to personally owned vehicles. With technology proven over years of self-driving deployments, Nuro gives automakers and mobility platforms a c

Full-time

USD 193,930.00 - 352,290.00 per year

Software Engineer L5 - AI Observability & Agent Evaluation

Los Gatos, California

•

Today

At Netflix, our mission is to entertain the world. Together, we are writing the next episode - pushing the boundaries of storytelling, global fandom and making the unimaginable a reality. We are a dream team obsessed with the uncomfortable excitement of discovering what happens when you merge creativity, intuition and cutting-edge technology. Come be a part of what's next. AI and ML power innovation in all areas of the business, including helping members choose the right title for them through

Full-time

USD 388,000.00 - 619,000.00 per year

OS Software Engineer, Evaluation

Cupertino, California

•

Today

For the engineer that obsesses on how software can enable OS developers to evaluate and improve their features, there is no better place than Apple's Experimentation team. The Experimentation team builds an end-to-end platform spanning the OS, data, and server for all the Apple OSes, operating at a scale of 2.5+ billion devices. We are addressing key challenges to accelerate the adoption of AI and an experimentation culture mindset across all Apple products/services. We are seeking engineers tha

Full-time

Machine Learning Evaluation Engineer

Sunnyvale, California

•

Today

The Data, Analytics and Quality (DAQ) team's core mission is to evaluate and elevate advanced sensing technologies. We collaborate closely with partners in computer vision, video engineering, and other applied ML domains to deliver high quality algorithms that power intelligent features across Apple's products. Our evaluations and analyses inform these teams and Apple leadership throughout the entire development cycle, from early prototyping to shipping a refined product. We are seeking a Machin

Full-time

AIML - Sr Software Engineer - AI, Evaluation

Cupertino, California

•

Today

Do you want to help build the next generation of Apple AI products? Our Evaluation organization measures quality across Apple Intelligence, Siri, and newest generative features, and our measurements directly inform launch decisions. Our team builds the platforms behind it: LLM-as-judge autograders, tools to validate them against human judgment, and systems that run them at scale. We are looking for a senior engineer to own a critical part of that platform and take it to the next level. Descrip

Full-time

Evaluation jobs in Belmont, CA, USA