Evaluation jobs in Armonk, NY

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Evaluation Engineer

New York, New York

•

5d ago

Role purpose Build and run tests that assess the quality and reliability of the firm's AI applications. Help maintain evaluation datasets, investigate failures and provide clear evidence of how AI systems perform on legal and business tasks. Key responsibilities Implement automated evaluation cases and supporting scripts using established frameworks and guidance from senior engineers. Prepare and maintain test datasets, source documents and reference examples with legal specialists. Follow requi

Full-time

USD 100,000.00 - 200,000.00 per year

BXMA - Business & Financial Evaluation - Analyst

New York, New York

•

30+d ago

Blackstone is the world's largest alternative asset manager. Blackstone seeks to deliver compelling returns for institutional and individual investors by strengthening the companies in which the firm invests. Blackstone's over $1.3 trillion in assets under management include global investment strategies focused on real estate, private equity, credit, infrastructure, life sciences, growth equity, secondaries and hedge funds. Further information is available at Follow @blackstone on LinkedIn, X (

Full-time

USD 110,000.00 - 125,000.00 per year

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Senior Engineer, R&D

Mahwah, New Jersey

•

Today

Work Flexibility: Hybrid The Senior Engineer, R&D focuses on product sustainment, continuous improvement, design changes, and lifecycle management, providing the opportunity to apply engineering expertise across manufacturing, quality, regulatory, and testing functions. You will play a key role in maintaining product performance, supporting technical investigations, and implementing engineering solutions throughout the product lifecycle. This role is Hybrid in Mahwah, NJ. What You Will Do Repre

Full-time

USD 93,200.00 - 155,400.00 per year

Senior Engineering Technician

Cortlandt, New York

•

Today

Duties Description Under the supervision of the Base Civil Engineer, the Senior Engineering Technician assists in the performance of civil engineering work and provides engineering support services through the inspection of construction projects, participation in field survey work, management of small project survey parties, collection and analyzation of engineering data, review of contracts and contract specifications, and preparation and review of maps and plans. The position performs respons

Full-time

USD 55,817.00 - 55,817.00 per year

Talent Development Specialist

New York, New York

•

10d ago

About the position We are looking for an enthusiastic self-starter with excellent project management and stakeholder management skills to join our Talent Development team. Our Talent Development Specialists help organize and run various global early career programs for new hires joining us straight from university, and support additional education offerings for our full-time employees across different departments as needed. You will work closely with key program stakeholders across Trading, HR,

Full-time

Senior Machine Learning Engineer - Fraud

New York, New York

•

24d ago

We believe that the way people interact with their finances will drastically improve in the next few years. We're dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their

Full-time

Electrical Engineer - Buildings

Stamford, Connecticut

•

Today

Stantec's Buildings team is on a mission to become the world's leading integrated design practice. Our architects, engineers, interior designers, consultants, sustainability specialists, and technologists are passionate about the power of design. Our collaborative culture and our innovative, sustainable approach to projects help us create buildings that matter to our world. Together, we are enhancing the quality of life globally through design. Join us and design your place with Stantec. Your Op

Full-time

USD 117,900.00 - 171,000.00 per year

2027 Software Engineering Intern - Agentic AI & Workflow Automation

Armonk, New York

•

Today

Introduction We are looking for motivated, curious, and technically strong software engineering interns to join our team this summer. You will work closely with senior engineers to design, build, and test next-generation agentic AI capabilities and automated workflows that support data and engineering operations at scale. This internship is ideal for students who enjoy hands-on development, exploring emerging AI patterns, and building real systems that will be used across the enterprise. Your r

Full-time

Scientific Data Architect - Tarrytown, NY

Tarrytown, New York

•

Today

About TetraScience TetraScience is the Scientific Data and AI Company building Tetra OS, the operating system for scientific intelligence. We help the world's leading life sciences firms turn fragmented scientific data into AI-native assets and scientific workflows that accelerate discovery, development, and manufacturing. TetraScience's growing ecosystem of strategic partners includes NVIDIA, Databricks, Thermo Fisher Scientific, Snowflake, Google, and Microsoft. In connection with your candi

Full-time

USD 140,000.00 - 240,000.00 per year

Sr. Information Analyst

Hackensack, New Jersey

•

Today

Description We are looking for an experienced Sr. Information Analyst to support IT risk, governance, and compliance initiatives in Hackensack, New Jersey. This role focuses on strengthening security and privacy practices by evaluating control environments, identifying compliance gaps, and helping align internal standards with recognized regulatory and industry frameworks. The ideal candidate will work closely with cross-functional teams, communicate findings to leadership, and contribute to awa

Easy Apply

Full-time

USD 140,000.00 - 170,000.00 per year

Software Framework Developer Assistant Vice President

Rutherford, New Jersey

•

Today

The Software Framework Developer is responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. Responsibilities: Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and imple

Full-time

USD 121,200.00 - 181,800.00 per year

Evaluation jobs in Armonk, NY 10504, USA