Evaluation jobs in audubon, pa

Lead Technology Product Manager – AI Quality & Evaluation

Hybrid in Philadelphia, Pennsylvania

•

Today

Lead Technology Product Manager AI Quality & EvaluationLocations: Waltham, MA | Philadelphia, PA | Coppell, TX | Other eligible U.S. office locations Work Arrangement: Hybrid 8 days per month onsite Employment Type: Full-Time Job SummaryWe are seeking a Lead Technology Product Manager specializing in AI Quality & Evaluation to translate quality standards and evaluation strategies into scalable product capabilities. This role focuses on AI evaluation workflows, automation, monitoring, quality r

Easy Apply

Full-time

Depends on Experience

Senior ML / Evaluation Engineer

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

3d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Summer Intern - Mechanical Engineering

Philadelphia, Pennsylvania

•

Today

Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the global workplace. About the role: The Mechanical Engineer Intern supports engineering activities associated with the evaluation, manufacturing, and procurement

Full-time

USD 25.40 - 29.00 per hour

Field Engineers

Philadelphia, Pennsylvania

•

Today

Overview Herzog Contracting Corp. is seeking qualified Field Engineers in Philadelphia, PA. Herzog is constructing a new 110,00 square foot heavy maintenance facility that will be equipped to inspect, test, and perform maintenance, services, and cleanings of fully assembled Amtrak trainsets of various sizes and capabilities including for the new Acela and Airo fleets. Duties and Responsibilities: *This is a non-exhaustive overview of the job duties for this position. Key duties include schedu

Full-time

Machine Learning Systems Engineer: Data

Bala Cynwyd, Pennsylvania

•

Today

Overview We're looking for a Machine Learning Systems Engineer to help build the data infrastructure that powers our AI research. In this role, you'll develop reliable, high-performance systems for handling large and complex datasets, with a focus on scalability and reproducibility. You'll partner with researchers to support experimental workflows and help translate evolving needs into efficient, production-ready solutions. The work involves optimizing compute performance across distributed sys

Full-time

New Grad Engineer I - Summer 2027

Philadelphia, Pennsylvania

•

Today

What We're Looking For At HNTB, you can create a career that is meaningful to you while building communities that matter to all of us. For more than a century, we have been delivering solutions for some of the largest, most complex infrastructure projects across the country. With our historic growth, it is an exciting time to join our team of employee-owners. This opportunity entails being responsible for assisting in the production and modification of design calculations, technical reports, eng

Full-time

Lead Product Manager

Philadelphia, Pennsylvania

•

Today

Description Penn Medicine is dedicated to our tripartite mission of providing the highest level of care to patients, conducting innovative research, and educating future leaders in the field of medicine. Working for this leading academic medical center means collaboration with top clinical, technical and business professionals across all disciplines. Today at Penn Medicine, someone will make a breakthrough. Someone will heal a heart, deliver hopeful news, and give comfort and reassurance. Our e

Full-time

Depends on Experience

Summer 2027 Internship (Mechanical Engineering Students)

Doylestown, Pennsylvania

•

Today

Wiss, Janney, Elstner Associates, Inc. (WJE) is seeking students pursuing a degree mechanical engineering for a Summer 2027 Internship with our Heavy Movable Structures team. This on-site role is based in Doylestown, Pennsylvania, a suburban Philadelphia location. Since 1956, WJE has been a global leader in engineering, architecture, and materials science, dedicated to solving, repairing, and preventing problems in the built environment. The Doylestown office specializes in the evaluation, test

Full-time

USD 17.00 - 35.00 per hour

Associate Engineer

Newtown Square, Pennsylvania

•

Today

Sunoco LPis a leading energy infrastructure and fuel distribution master limited partnership operating across 32 countries and territories in North America, the Greater Caribbean, and Europe. The Partnership's midstream operations include an extensive network of approximately 14,000 miles of pipeline and over 160 terminals. This critical infrastructure complements the Partnership's fuel distribution operations, which distribute over 15 billion gallons annually to approximately 11,000 Sunoco and

Full-time

Aerospace Engineer / Mechanical Engineer

Chesterbrook, Pennsylvania

•

Today

Responsibilities Standard Job Description: Performs technical planning, system integration, verification and validation, cost and risk, and effectiveness analysis for total systems. Analyses are performed at all levels of total system products to include concept, design, fabrication, test, installation, operation, maintenance and disposal. Ensures the logical and systematic conversion of customer or product requirements into total systems solutions that acknowledge technical, schedule, and cos

Full-time

USD 56,435.08 - 98,129.65 per year

IT Manager/Director

Media, Pennsylvania

•

Today

Description We are looking for an experienced IT leader to help guide technology operations and cybersecurity efforts for a growing, multi-entity organization in Media, Pennsylvania. This role partners closely with senior technology leadership to strengthen security practices, improve service delivery, and support practical business needs across multiple operating companies. The position is well suited for someone who combines technical depth with sound judgment and can grow into broader strateg

Easy Apply

Full-time

USD 160,000.00 - 170,000.00 per year

Senior Engineer

Newtown Square, Pennsylvania

•

Today

Full-time

Evaluation jobs in Audubon, PA, USA