Evaluation jobs in annapolis, md

Research Lead - AI Cyber Testing & Evaluation

Hybrid in Washington, District of Columbia

•

Today

Job Type: Term (Fixed Term) Position Description RAND's Center on AI, Security, and Technology (CAST) , part of the Global and Emerging Risks (GER) Division conducts cutting-edge research on transformative, high-impact technologies-including artificial intelligence and biotechnology-to shape policies that protect global security and advance the public good. You will be responsible for managing significant research budgets and personnel, overseeing complex technical research and policy analysis

Full-time

USD 150,100.00 - 268,500.00 per year

Test and Evaluation Engineer

Washington, District of Columbia

•

Today

Job Number: R0251169 Test and Evaluation Engineer The Opportunity: As a Test and Evaluation (T&E) Subject Matter Expert (SME) on our team, you'll work with a team of experts to create comprehensive test plans and documentation to support acquisition strategies for Navy surface, undersea, and cyber systems. You'll support the development and maintenance of Test and Evaluation Master Plans (TEMP) in accordance with DoW and Navy T&E guidance, policies, and templates. You'll use your experience to c

Full-time

USD 86,800.00 - 198,000.00 per year

Senior ML / Evaluation Engineer

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Yesterday

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

AI voice Evaluation Specialist

Remote

•

8d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

3d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Software Test & Evaluation Engineer

Maryland

•

Today

Leidos has a new and exciting opportunity for a Software Test & Evaluation Engineer in our Intel Sector. Our talented team is at the forefront in Security Engineering, Computer Network Operations (CNO), Mission Software, Analytical Methods and Modeling, Signals Intelligence (SIGINT), and Cryptographic Key Management. At Leidos, we offer competitive benefits, including Paid Time Off, 11 paid Holidays, 401K with a 6% company match and immediate vesting, Flexible Schedules, Discounted Stock Purchas

Full-time

USD 92,300.00 - 166,850.00 per year

Senior Test and Evaluation Engineer

Washington, District of Columbia

•

Today

The Senior Test and Evaluation Engineer will support a high-profile Air Force customer at Joint Base Anacostia-Bolling, DC. The customer organization is responsible for capability development and development planning. The Test and Evaluation Engineer will work with internal and external stakeholders to plan, execute, assess, and document Developmental Testing (DT) and Operational Testing (OT) of tactical command and control (C2) systems. Some travel is expected (up to 20%). Responsibilities: S

Full-time

USD 150,000.00 - 220,000.00 per year

Test & Evaluation Engineer

Washington, District of Columbia

•

Today

Overview VTG is seeking a Mid to Senior Test & Evaluation Engineer at the Washington, DC Navy Yard to provide Engineering Support Services to Engineers and Subject Matter Experts in support of the Conventional Prompt Strike (CPS) Program under the Department of Navy. Position is mostly onsite with occasional telework. The candidate will be supporting multiple engineering disciplines such as the following but not limited to: Mechanical, Electrical, Systems, Information Systems, Navigation, Fligh

Full-time

USD 100,000.00 - 160,000.00 per year

Operational Test and Evaluation Engineer SME

Washington, District of Columbia

•

Today

Overview Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and practice, producing Results that Matter. Come work with the best! We offer opportunity, unique challenges, and clear-sighted commitment to

Full-time

USD 140,000.00 per year

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Systems Engineer 2 - (Systems Engineering, ISO/IEC 15288)

Annapolis, Maryland

•

Today

Systems Engineer 2 - (Systems Engineering, ISO/IEC 15288) Clearance: TS/SCI - Polygraph required Position ID: 15-TSK-2.9-015-SE2 Location: Annapolis Junction, Maryland Description: Support the HPDA PMO with gathering data and generating critical systems engineering documentation such as Requirements Verification, Traceability Matrix (RVTM), Test and Evaluation Master Plan (TEMP), Life Cycle Sustainment Plan (LCSP), System Architecture Documents, and others as needed. Apply systems engineerin

Full-time

USD 137,000.00 - 168,000.00 per year

System Engineer (Levels I - VI)

Annapolis, Maryland

•

Today

Job Title: System Engineer (Levels I - VI) Location(s): Annapolis Junction, Maryland Hours: Regular Full-Time Salary Range: $130k/yr - $232k/yr Clearance Requirements This position requires a current and active TS/SCI with Poly at the time of application. What you will be doing: Applies systems engineering principles throughout the systems life cycle phases: Concept, Development, Production, Utilization, Support, and Retirement. Interacts with the Government regarding Systems Engineering technic

Full-time

USD 130,000.00 - 232,000.00 per year

Cloud Software Engineer

Annapolis, Maryland

•

Today

Red Arch Solutions is looking for a Cloud Software Engineer to provide cloud software research, development, and engineering services to include requirements analysis, software development, installation, integration, evaluation, enhancement, sustainment, testing, validation, and issue diagnosis/resolution. Qualifications: Five (5) or more years of directly related experience Bachelor's Degree in Computer Science or in a related technical field is highly desired which will be considered equivalen

Full-time

USD 175,000.00 - 187,000.00 per year

Systems Engineer 3 (AWF - 082)

Annapolis, Maryland

•

Today

Description Serving Maryland and the Greater Washington D.C. area, SageCor Solutions (SageCor) is a growing company bringing complete engineering services and true full lifecycle System Engineering services to areas requiring (or desiring) nationally-recognized expertise in high performance computing, large data analytics and cutting edge information technologies. Active TS/SCI w/ Polygraph required. Required Experience: A High School Diploma or GED plus six (6) years of general system engine

Full-time

Test Engineer - Pipeline

Fort Meade, Maryland

•

Today

TS/SCI FS poly required. *This is a pipeline position for an anticipated new contract, with staffing expected to begin in November 2026. Employment opportunities are contingent upon final staffing requirements. Applications are being accepted in advance to identify qualified candidates for potential openings.* Description Evaluate, recommend, and implement automated test tools and strategies. Design, implement, and conduct test and evaluation procedures to ensure system requirements are met. D

Full-time

Evaluation jobs in Annapolis, MD, USA