Evaluation jobs in Berkeley, CA

Sr. Engineer - AI Evaluation & Reliability

Hybrid in Redwood City, California

•

11d ago

Job Description - Need locals and no 3rd party candidates Sr. Engineer - AI Evaluation & Reliability ( W2 ) Hybrid - Redwood City, CA Skype JD 6+ years building evaluation or testing infrastructure for ML/LLM systems or large-scale distributes system Proven ability to translate product requirements into measurable metrics and test plans. Strong Python skills Strong Experience with modern data tooling Hands-on experience running A/B tests, canaries, or experiment frameworks. Experience defining a

Easy Apply

Contract

65 - 75

Quality Analysis

San Francisco, California

•

7d ago

Quality AnalysisThe Quality Analyst is responsible for evaluating processes, products, and service interactions to ensure they meet organizational standards and client expectations. The role involves identifying gaps, providing data-driven insights, and collaborating with cross-functional teams to improve quality and operational efficiency. Key Responsibilities1. Quality Monitoring & EvaluationConduct audits of processes, calls, tickets, documents, or product outputs as per defined QA frameworks

Easy Apply

Full-time

40,000 - 60,000

Healthcare Delivery AI Evaluation Architect

Remote or San Francisco, California

•

Today

We are so glad you are interested in joining Sutter Health! Organization: SHSO-Sutter Health System Office-Bay Position Overview: Participates in artificial intelligence (AI) governance by developing adoption and evaluation methodology and scale AI-enabled workflows using evidence-based implementation methods. The role will co-design egoals and monitoring plans with business and clinical stakeholders, align success metrics to operational and clinical goals, and run hybrid effectiveness-impleme

Full-time

Compensation information provided in the description

Senior Prompt and Benchmark Engineer, Evaluation of World Models

Remote or Santa Clara, California

•

Today

At NVIDIA, we're not just building the future, we're generating it! Our Cosmos generative AI engineering team is pushing the boundaries of what's possible across multimodal learning, video generation, synthetic data, intelligent simulation, and agentic systems. We are looking for exceptionally driven engineers and applied scientists with deep experience in generative modeling to help improve the quality of our world models! What you'll be doing: Develop detailed, domain-specific benchmarks for

Full-time

USD 184,000.00 per year

Lead Cyber Evaluation Expert

Remote or Columbia, Maryland

•

Today

Overview SilverEdge is a premier provider of innovative cyber, software, and intelligence solutions, addressing mission-critical challenges for the Department of Defense (DoD), Intelligence Community (IC), and beyond. We are dedicated to delivering impactful results to meet mission goals through cutting-edge technology and expertise. We are seeking a Lead Cyber Evaluation Expert to join our dynamic team. This individual will oversee a multi-disciplinary team conducting cybersecurity and respons

Full-time

Software Engineer L4/L5, LLM Evaluation & Infrastructure, Machine Learning Platform

Remote

•

Today

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. Machine Learning/Artificial Intelligence powers innovation in all areas of the business, from helping members choose the right title for them through personalization, t

Full-time

USD 100,000.00 per year

Engineering Manager, Comms and Experimentation Platform

San Francisco, California

•

Today

About This Role Strava is the app for active people. With over 150 million athletes in more than 185 countries, Strava is where connection, motivation, and personal bests thrive. No matter your activity, gear, or goals, we help you find your crew, crush your milestones, and keep moving forward. Start your journey with Strava today. Our mission is simple: to motivate people to live their best active lives. We believe in the power of movement to connect and drive people forward. Strava is hirin

Full-time

USD 228,000.00 - 242,000.00 per year

Structural Engineering Intern - Buildings (Summer 2026)

San Francisco, California

•

Today

Job Description Learning begins in the classroom but there's no better place to gain real-world experience than with Stantec. Interns are an integral part of our teams, working to solve some of the world's most complex challenges. As an intern, you'll work alongside our experienced practitioners and with our clients and communities. This hands-on experience will equip you with practical skills, build your network, and provide opportunities that set you up for success. Stantec Buildings is on

Full-time

USD 23.47 - 34.50 per hour

Staff Data Scientist, Ads Performance

Remote or San Francisco, California

•

Today

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility

Full-time

USD 164,695.00 - 339,078.00 per year

Program Manager Ecommerce Logistics

San Francisco, California

•

Today

Program Manager Ecommerce Logistics Locations: SFO, CA / Rocklin, CA / San Jose, CA / Memphis, TN Requirements: 1. Recent retail experience is a must. 2. Prefer candidates with deep experience in Logistics, Manufacturing, Final mile and related technologies 3. Strong Planning skills and not just technical experience in these areas Detailed JD: Uses established project management methodologies/tools to develop and execute Technology project plans. Specific Responsibilities Performs all of the

Easy Apply

Contract, Third Party

Depends on Experience

Program Manager - Retail Supply Chain

San Francisco, California

•

Today

Program Manager - Supply Chain, Retail Locations: SFO, CA / Rocklin, CA / San Jose, CA / Memphis, TN Requirements: 1. Recent retail experience is a must. 2. Prefer candidates with deep experience in Logistics, Manufacturing, Final mile and related technologies 3. Strong Planning skills and not just technical experience in these areas Detailed JD: Uses established project management methodologies/tools to develop and execute Technology project plans. Specific Responsibilities Performs all of the

Easy Apply

Contract, Third Party

Depends on Experience

Structural Engineering Intern - Buildings (Summer 2026)

San Francisco, California

•

Today

Learning begins in the classroom but there's no better place to gain real-world experience than with Stantec. Interns are an integral part of our teams, working to solve some of the world's most complex challenges. As an intern, you'll work alongside our experienced practitioners and with our clients and communities. This hands-on experience will equip you with practical skills, build your network, and provide opportunities that set you up for success. Stantec Buildings is on a mission to become

Full-time

USD 23.47 - 34.50 per hour

Staff Machine Learning Engineer - Uber AI Solutions

San Francisco, California

•

Today

About the Role Uber AI Solutions is one of Uber's biggest bets with the ambition to build one of the world's largest data foundries for AI applications and evolve into a platform of choice for a variety of online tasks. The Moonshot AI team focuses on optimizing the Uber AI Solutions gig marketplace through intelligent supply and demand matching. We also accelerate human-in-the-loop data annotation with automation and develop robust automated evaluation systems. We are in the early stages, wit

Full-time

USD 223,000.00 - 248,000.00 per year

Senior Machine Learning Engineer, Stripe Assistant

Remote or San Francisco, California

•

Today

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies-from the world's largest enterprises to the most ambitious startups-use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important

Full-time

Senior Server Engineer, Achieve

San Francisco, California

•

Today

Full-time

USD 198,000.00 - 220,400.00 per year

Engineering Manager, Evaluations & Observability

San Francisco, California

•

Today

ABOUT RETOOL Nearly every company in the world runs on custom software for critical operations like tracking performance metrics, handling customer support workflows, building admin dashboards, and countless other processes you might not have even thought of. But most companies don't have adequate resources to properly invest in these tools, leading to a lot of old and clunky internal software or, even worse, users still stuck in manual and spreadsheet flows. At Retool, we're building the firs

Full-time

USD 188,400.00 - 251,900.00 per year

Software Engineer, Stripe Assistant

San Francisco, California

•

Today

Full-time

Senior Engineer II, Copilots

San Francisco, California

•

Today

Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you'll find your place here. We value winning together-while learning, having fun, and making a profound difference for the dreamers and builders in the world. We're seek

Full-time

USD 154,000.00 - 192,000.00 per year

Senior Project Manager Retail Logistics

San Francisco, California

•

Today

Senior Project Manager Logistics Location: SFO, CA / Rocklin, CA / San Jose, CA / Memphis, TN Requirements: 1. Recent retail experience is a must. 2. Prefer candidates with strong experience in Logistics, middle and final mile, returns and transportation projects. 3. Focus on clear planning and alerting delays to plan. Not just technical experience in the Logistics technologies Details: Uses established project management methodologies/tools to develop and execute IT project plans. Responsible f

Easy Apply

Contract, Third Party

Depends on Experience

Senior Process Engineer, Water

Walnut Creek, California

•

Today

Communities everywhere share the need for clean water. And as they work to meet that need, they're facing new, more complex challenges every day. Our water professionals collaborate to contribute innovative ideas, guided by scientific rigor and a vision for sustainable growth. Every day, we're helping communities improve, reuse, and protect our world's most precious resource. Join our team to deliver transformational projects that will benefit future generations. Grow with us, H2O+U. Your Opport

Full-time

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Evaluation jobs in Berkeley, CA, USA