Evaluation jobs in Beavercreek, OH

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Senior Test and Evaluation Engineer

Dayton, Ohio

•

Today

The Senior Test and Evaluation Engineer will support a high-profile Air Force customer at Wright-Patterson Air Force Base in Dayton, OH. The customer organization is responsible for capability development and development planning. The Test and Evaluation Engineer will work with internal and external stakeholders to plan, execute, assess, and document Developmental Testing (DT) and Operational Testing (OT) of tactical command and control (C2) systems. Some travel is expected (up to 20%). Respons

Full-time

USD 150,000.00 - 200,000.00 per year

Test and Evaluation Engineer - Principal

Wright-Patterson Air Force Base, Ohio

•

Today

Modern Technology Solutions, Inc. (MTSI) is seeking a Test and Evaluation Engineer, Principal in Dayton, OH to provide planning, execution, and evaluation of AFRL technology development project demonstrations. How you will contribute to our National Security and Defense mission: As a Test and Evaluation Engineer, Principal with MTSI, you will be responsible for providing test planning support and execution for cutting-edge technologies for the Air Force Research Lab (AFRL). You will sit in the

Full-time

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Process Engineer

Miamisburg, Ohio

•

12d ago

SUMMARY Conduct liaison activities between the customer, application sales manager, regional sales manager and Headquarters to resolve and clarify technical matters pertaining to equipment issues, selection and enhancements. ESSENTIAL DUTIES AND RESPONSIBILITIES include the following. Other duties may be assigned. Demonstrate technical proficiency in three (3) to four (4) major, distinct application market segments. Support sales efforts through effective demonstrations of complex product/proc

Full-time

Senior Acquisition Electrical Engineer

Dayton, Ohio

•

Today

MTSI is looking for a strong Senior Electrical Engineer to support the B-2 SPO at Wright-Patterson AFB, OH. We need someone with experience across electronics engineering-design, development, testing/evaluation, implementation, maintenance, production, and sustainment of new or existing weapon systems, avionics, communication systems, or subsystems. This role will lean heavily on someone who understands Air Force systems acquisition, hardware/software integration at the system and subsystem lev

Full-time

Senior Aerospace Engineer

Wright-Patterson Air Force Base, Ohio

•

Today

How you will contribute to our National Security and Defense mission: MTSI is seeking a well-qualified candidate to function as a Senior Aerospace Engineer supporting AFLCMC/WBZ at Wright-Patterson AFB, OH. The qualified candidate shall have knowledge of armament integration in support of the design, development, testing and evaluation, implementation, maintenance, production and sustainment of new and/or existing weapon or like subsystems. The candidate shall apply an understanding of Air Force

Full-time

Test Engineer

Beavercreek, Ohio

•

Today

MTSI is seeking a highly skilled Test Engineer to support an advanced air platform program at Wright Patterson Air Force Base in Dayton, OH. Job Duties: Advise project leads and engineers on test engineering as it applies to highly technical program office efforts. Contribute to test planning working groups, technical interchanges, and day-to-day interactions with small government and industry teams. Develop and execute program test activities, including the planning, execution, and reporting of

Full-time

Senior Systems Engineer

Wright-Patterson Air Force Base, Ohio

•

Today

MTSI is seeking a Senior Systems Engineer with a TS/SCI clearance to provide support to a Government Office at WPAFB, Ohio. The engineer's primary focus will be to provide system engineering and test engineering support to multiple program teams. The individual will work with other PMs, Engineers, Security, and internal and external stakeholders to further the Government's acquisition strategy goals and objectives managed by AFLCMC. Responsibilities Assist in translating user requirements into s

Full-time

Systems Engineer, Journeyman - TS

Dayton, Ohio

•

15d ago

This site uses cookies to improve the user experience! Would you like to allow cookies? Accept Cookie Settings Systems Engineer, Journeyman - TS DCS Corp | Dayton Apply Now Get job alerts by email. Sign up now! Job details DCS has an exciting opportunity for a Systems Engineer to provide support to the Command, Control, Communications, and Battle Management Division (C3BM). Command, Control, Communications, and Battle Management (C3BM) has been tasked with delivering an integrated Department

Full-time

Data Analyst

Moraine, Ohio

•

Today

I. Job ProfileJob TitleData AnalystDepartmentLamination AssemblyDirect SupervisorLamination Assembly ManagerDirect SubordinatesNoneII. Job Summary? 1?Verify data in Plex, in charge of correcting and standardize the Plex operation and provide training to guarantee the accuracy of the system. 2?Collect, analyze, track and supervise the implementation of important data of the department, such as KPI data, weekly reports, monthly reports, handling of overdue inventory, writing of work instructions

Full-time

Transmission Planning Engineer

Dayton, Ohio

•

Today

Are you ready to be part of a company that's not just talking about the future, but actively shaping it? Join The AES Corporation, the largest US-based global power company with a team of 8,300 employees across 12 countries. AES has been ranked #1 by BloombergNEF in renewable energy sales to corporations in the US and Americas for five consecutive years, providing electricity for millions of people worldwide. We are proud to foster a strong workplace culture, earning prominent positions in Great

Full-time

Senior Training Systems Engineer

Dayton, Ohio

•

Today

Applied Research Solutions is looking for a Senior Training Systems Engineer to support the Air Force Life Cycle Management (AFLCMC) programs at WPAFB, OH. The Senior Training Systems Engineer will be supporting acquisition, development, integration, sustainment, and training systems across the weapon system lifecycle. This role interfaces with government, contractor, and external stakeholders to ensure uninterrupted program execution, compliance, and operational effectiveness. This position sup

Full-time

Evaluation jobs in Beavercreek, OH, USA