Evaluation jobs in Bay Point, CA

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer, Simulation & Evaluation

Alameda, California

•

Today

THE COMPANY Saildrone is a maritime defense company and the global leader in autonomous unmanned surface vehicles (USVs). With more ocean miles and real-world operational experience than any USV manufacturer or operator, Saildrone maintains active, combat-deployed systems supporting national security and force projection around the world, 24/7/365. Saildrone's manufacturing and R&D headquarters are located in Alameda, CA, with business development and sales operations in Washington, DC, and dep

Full-time

USD 144,500.00 - 300,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Chief Engineer

Walnut Creek, California

•

Today

City, State: Walnut Creek, California Title: Chief Engineer Location: Walnut Creek, CA FLSA: Exempt Status: full-time, Reports to: General Manager Supervises: Maintenance Department Pay Range: $85,000 - $90,000 Job Summary: The Chief Engineer oversees the maintenance operations of the hotel, ensuring all systems, including refrigeration, heating, plumbing, and energy controls, are functioning efficiently. This role manages maintenance staff and contractors, ensuring compliance with safety sta

Full-time

USD 85,000.00 - 90,000.00 per year

Field Engineer Intern

Concord, California

•

Today

Overview Work and train with the industry's finest professionals! Flatiron's Intern Program provides challenging and rewarding work opportunities for college students majoring in Civil Engineering, Mechanical Engineering and Construction Management. As an Intern, you will be given the opportunity to apply your academic training and skills in a real-world setting at any number of project locations. In addition, you will assist the project manager, project engineer, and the rest of the on-site c

Full-time

USD 26.00 - 30.00 per hour

Engineer I - Mechanical

Oakland, California

•

Today

What We're Looking For At HNTB, you can create a career that is meaningful to you while building communities that matter to all of us. For more than a century, we have been delivering solutions for some of the largest, most complex infrastructure projects across the country. With our historic growth, it is an exciting time to join our team of employee-owners. This opportunity entails being responsible for assisting in the production and modification of design calculations, technical reports, eng

Full-time

USD 83,008.49 - 124,512.74 per year

WED - 2027 New Grad Mechanical & Fire Protection Engineer I (For Current & Recent HNTB Interns Only)

Oakland, California

•

Today

What We're Looking For For Current & Recent HNTB Interns Only At HNTB, you can create a career that is meaningful to you while building communities that matter to all of us. For more than a century, we have been delivering solutions for some of the largest, most complex infrastructure projects across the country. With our historic growth, it is an exciting time to join our team of employee-owners. This opportunity entails being responsible for assisting in the production and modification of des

Full-time

USD 83,008.49 - 124,512.74 per year

Intern, Flood Engineering

San Ramon, California

•

Today

Overview At BHSI, we believe in empowering our customers to navigate a world full of uncertainty. Property and Casualty (P&C) Insurance plays a vital role in helping individuals and businesses manage risk by transferring potential financial losses to insurers. As a Flood Engineering Intern, you will contribute to projects within the Catastrophe Engineering and Analytics (CAT E&A) team. CAT E&A is an innovative, multidisciplinary group that evaluates catastrophe risk globally, develops independ

Full-time

USD 33.00 per hour

Product Engineer, AI Email Applications, Artificial Intelligence (AI) Required - Work From Home

Remote or San Francisco, California

•

Today

Company Description Job Description Product Engineer, AI Email Applications, Artificial Intelligence (AI) Required - Work From Home As Product Engineer, AI Email Applications, you will work at the intersection of user needs, model capability, and engineering constraints. The Product Engineer will work directly with Machine Learning (ML) and engineering teams to define how the system should behave, how we measure it, and how we continuously improve it. This is a deeply technical, hands-on role

Full-time

Machine Learning (ML) Engineer, Ranking & Retrieval, Machine Learning (ML) and Artificial Intelligence (AI) Required, Work From Home

Remote or San Francisco, California

•

Today

Company Description Job Description Machine Learning (ML) Engineer, Ranking & Retrieval, Machine Learning (ML) and Artificial Intelligence (AI) Required, Work From Home The Machine Learning (ML) Engineer will build and improve Machine Learning (ML) systems that power our AI-native applications. You will work on classification, retrieval, ranking, personalization and evaluation, taking ownership from model development to production deployment. This role is for engineers who enjoy solving pract

Full-time

Applied Machine Learning (ML) Engineer, Machine Learning (ML) and Artificial Intelligence (AI) Required, Work From Home

Remote or San Francisco, California

•

Today

Company Description Job Description Applied Machine Learning (ML) Engineer, Machine Learning (ML) and Artificial Intelligence (AI) Required, Work From Home The Applied Machine Learning (ML) Engineer will build and improve Machine Learning (ML) systems that power our AI-native applications. You will work on classification, retrieval, ranking, personalization and evaluation, taking ownership from model development to production deployment. This role is for engineers who enjoy solving practical

Full-time

Senior Structural Engineer

Walnut Creek, California

•

Today

At Stantec, we know the work we do matters. From decarbonizing mines to modernizing electric grids and building the infrastructure that fuels communities, we're powering the world. Our clients come to us with their biggest, most complex challenges because that's where we thrive. And we're looking for problem solvers, high achievers, and visionaries to help us. Join us for a chance to grow professionally at one of the world's top design firms while building our clean energy future. Your Opportuni

Full-time

USD 110,300.00 - 165,500.00 per year

Senior Reliability Engineer, Power Electronics

Berkeley, California

•

Today

Are you ready to build America's energy future? Form Energy is an American manufacturing and energy technology company. We're revolutionizing energy storage with cost-effective, multi-day technology designed to keep the electric grid secure and reliable, even during extended periods of stress. By strengthening the electric system and reimagining what's possible, we're giving clean energy a whole new form! In recent years, Form Energy has earned a number of accolades, including being named by TIM

Full-time

USD 147,959.00 - 184,966.00 per year

Evaluation jobs in Bay Point, CA, USA