Evaluation jobs in berkeley heights, nj

Senior Test and Evaluation System Engineer

Rockaway Township, New Jersey

•

Today

Job ID: 2617308 Location: Picatinny Arsenal, NJ, US Date Posted: 2026-09-29 Category: Engineering and Sciences Subcategory: Specialty Engr Schedule: Part-Time Shift: Day Job Travel: Yes - 10% of the time Minimum Clearance Required: Secret Clearance Level Must Be Able to Obtain: None Potential for Remote Work: ORA_HYBRID Description SAIC is seeking a Senior Test and Evaluation System Engineer to provide senior-level engineering, production, acquisition, and technical advisory support to

Full-time

USD 80,001.00 - 120,000.00 per year

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

New York, New York

•

Today

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterprises leveraging AI. From

Full-time

AI Engineer 5 (Gen AI SDK: Agentic AI, Guardrails, Evaluation)

New York, New York

•

Today

AI Engineer 5 (Gen AI SDK: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterprises leveraging AI. From informing cust

Full-time

AI Engineer 4 (AI Foundations: Benchmarking, Evaluation, and Explainability)

New York, New York

•

Today

AI Engineer 4 (AI Foundations: Benchmarking, Evaluation, and Explainability) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterprises leveraging AI. From

Full-time

AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory)

New York, New York

•

Today

AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterp

Full-time

Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

New York, New York

•

Today

Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterprises leveragin

Full-time

Senior ML / Evaluation Engineer

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Java Developer

Hybrid in New York, New York

•

6d ago

Our goal is to solve problems and deliver results for our clients. At Cloud and Things, you can be a part of transforming the public sectors IT environment. Our team is on the forefront of helping to solve the government's most complex IT challenges. If you are seeking a role that offers the opportunity to work on rewarding projects, consider a career with Cloud and Things. *This is an exempt position. Salarycommensuratewith experience* Job Title: Java Developer Location: New York, NY (Hybrid)

Easy Apply

Full-time

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

AI Engineer

New York, New York

•

Yesterday

Our client a leading asset management firm, located in New York City is looking to hire an AI Engineer to join their Business Technology and Data Team. This is a Full Time Position. Work will be conducted 3 days in office and 2 day from home. Citizens and those authorized to work in the U.S. are encouraged to apply. Qualified candidates should send their resumes (Word Format) along with salary expectations to . SUMMARY The AI Engineer will work closely with the Investment Research team to desig

Easy Apply

Full-time

$150000 - $170000

Evaluation Engineer

New York, New York

•

6d ago

Role purpose Build and run tests that assess the quality and reliability of the firm's AI applications. Help maintain evaluation datasets, investigate failures and provide clear evidence of how AI systems perform on legal and business tasks. Key responsibilities Implement automated evaluation cases and supporting scripts using established frameworks and guidance from senior engineers. Prepare and maintain test datasets, source documents and reference examples with legal specialists. Follow requi

Full-time

USD 100,000.00 - 200,000.00 per year

Data Analyst & Program Evaluation Specialist, Bureau of Communicable Diseases

New York, New York

•

Today

Company Description Job Description The Bureau of Communicable Disease (BCD) oversees surveillance and investigations of more than 70 reportable diseases. This Communicable Diseases Data Analyst and Program Evaluation Specialist position sits in BCD's Investigation and Response Unit. DUTIES WILL INCLUDE BUT NOT BE LIMITED TO: The analyst will use data to evaluate disease investigation and surveillance processes and the progress of investigations. Under general direction, with very wide latitu

Full-time

USD 100,000.00 - 125,000.00 per year

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Application Engineering Adhesives Packaging Industry Intern - Summer 2027

Bridgewater, New Jersey

•

Today

About this Position At Henkel, you'll be part of an organization that's shaping the future through innovation, sustainability and collaboration. With our trusted brands like Persil , 'all , Loctite , Snuggle , and Schwarzkopf and our cutting-edge technologies, you'll have countless opportunities to explore new paths and grow. This position is with our Adhesive Technologies business unit - where we empower our people to transform industries and provide our customers with a competitive advantage

Full-time

USD 22.00 - 27.00 per hour

Evaluation jobs in Berkeley Heights, NJ, USA