Evaluation jobs in bala cynwyd, pa

Lead Technology Product Manager – AI Quality & Evaluation

Hybrid in Philadelphia, Pennsylvania

•

Today

Lead Technology Product Manager AI Quality & EvaluationLocations: Waltham, MA | Philadelphia, PA | Coppell, TX | Other eligible U.S. office locations Work Arrangement: Hybrid 8 days per month onsite Employment Type: Full-Time Job SummaryWe are seeking a Lead Technology Product Manager specializing in AI Quality & Evaluation to translate quality standards and evaluation strategies into scalable product capabilities. This role focuses on AI evaluation workflows, automation, monitoring, quality r

Easy Apply

Full-time

Depends on Experience

Senior ML / Evaluation Engineer

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Lead Product Manager

Philadelphia, Pennsylvania

•

Today

Description Penn Medicine is dedicated to our tripartite mission of providing the highest level of care to patients, conducting innovative research, and educating future leaders in the field of medicine. Working for this leading academic medical center means collaboration with top clinical, technical and business professionals across all disciplines. Today at Penn Medicine, someone will make a breakthrough. Someone will heal a heart, deliver hopeful news, and give comfort and reassurance. Our e

Full-time

Depends on Experience

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Field Engineers

Philadelphia, Pennsylvania

•

Today

Overview Herzog Contracting Corp. is seeking qualified Field Engineers in Philadelphia, PA. Herzog is constructing a new 110,00 square foot heavy maintenance facility that will be equipped to inspect, test, and perform maintenance, services, and cleanings of fully assembled Amtrak trainsets of various sizes and capabilities including for the new Acela and Airo fleets. Duties and Responsibilities: *This is a non-exhaustive overview of the job duties for this position. Key duties include schedu

Full-time

Machine Learning Systems Engineer: Data

Bala Cynwyd, Pennsylvania

•

Today

Overview We're looking for a Machine Learning Systems Engineer to help build the data infrastructure that powers our AI research. In this role, you'll develop reliable, high-performance systems for handling large and complex datasets, with a focus on scalability and reproducibility. You'll partner with researchers to support experimental workflows and help translate evolving needs into efficient, production-ready solutions. The work involves optimizing compute performance across distributed sys

Full-time

New Grad Engineer I - Summer 2027

Philadelphia, Pennsylvania

•

Today

What We're Looking For At HNTB, you can create a career that is meaningful to you while building communities that matter to all of us. For more than a century, we have been delivering solutions for some of the largest, most complex infrastructure projects across the country. With our historic growth, it is an exciting time to join our team of employee-owners. This opportunity entails being responsible for assisting in the production and modification of design calculations, technical reports, eng

Full-time

Summer Intern - Mechanical Engineering

Philadelphia, Pennsylvania

•

Today

Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the global workplace. About the role: The Mechanical Engineer Intern supports engineering activities associated with the evaluation, manufacturing, and procurement

Full-time

USD 25.40 - 29.00 per hour

Mechanical Design Engineering Manager

Camden, New Jersey

•

Today

The Mechanical Engineering Manager will manage and oversee a team of engineers responsible for the design qualification and structural integrity assessment of mechanical components (heat exchangers, pressure vessels, tanks, etc.), component supports, piping systems and vessel internals for advanced reactors including SMRs. This role combines deep technical expertise in stress analysis, fracture mechanics evaluation, and fatigue and vibration assessment with a proven background in multidisciplina

Full-time

USD 19,000.00 per month

Engineering Internship

Philadelphia, Pennsylvania

•

Today

About the Organization Founded in 1994 as a small, diversified professional services company, Delphinus today employs more than 650 professional and technical personnel supporting a customer base that spans the Defense and Federal markets. Headquartered in Newtown Square, PA, we have primary offices in Norfolk, VA; San Diego, CA; and Bremerton, WA. Company Benefits*: Comprehensive health program for employee and dependents Company paid Dental and Vision 401(k) with company match Short-term an

Full-time

USD 25.00 - 29.00 per hour

Electrical Engineer

Philadelphia, Pennsylvania

•

Today

At Ballinger, we are passionate about complex challenges and real-world problem-solving. Design challenges come in all shapes and sizes, and the ones we prefer test us as design professionals. We seek out complex projects with big impact because they require us to ask tough questions, synthesize data, and push past the boundaries of existing answers into the realm of innovative solutions. Ballinger team members thrive on those challenges because our clients do, too: our work for them enables the

Full-time

Technical Project Manager

Philadelphia, Pennsylvania

•

Today

Salary Range: $123,639 - $160,800 DCS is seeking a Technical Project Manager to guide multidisciplinary teams delivering electronic warfare threat representative targets and simulation systems for test and training ranges. You'll work alongside government and contractor partners to plan and deliver complex technical projects from requirements and design reviews through integration, testing, and operational support. This role is a good fit for a technical leader who can connect engineering projec

Full-time

USD 123,639.00 - 160,800.00 per year

IT Manager/Director

Media, Pennsylvania

•

Today

Description We are looking for an experienced IT leader to help guide technology operations and cybersecurity efforts for a growing, multi-entity organization in Media, Pennsylvania. This role partners closely with senior technology leadership to strengthen security practices, improve service delivery, and support practical business needs across multiple operating companies. The position is well suited for someone who combines technical depth with sound judgment and can grow into broader strateg

Easy Apply

Full-time

USD 160,000.00 - 170,000.00 per year

Evaluation jobs in Bala Cynwyd, PA, USA