Evaluation jobs in ashburn, va

Research Lead - AI Cyber Testing & Evaluation

Hybrid in Washington, District of Columbia

•

Today

Job Type: Term (Fixed Term) Position Description RAND's Center on AI, Security, and Technology (CAST) , part of the Global and Emerging Risks (GER) Division conducts cutting-edge research on transformative, high-impact technologies-including artificial intelligence and biotechnology-to shape policies that protect global security and advance the public good. You will be responsible for managing significant research budgets and personnel, overseeing complex technical research and policy analysis

Full-time

USD 150,100.00 - 268,500.00 per year

Test and Evaluation Engineer

Washington, District of Columbia

•

Today

Job Number: R0251169 Test and Evaluation Engineer The Opportunity: As a Test and Evaluation (T&E) Subject Matter Expert (SME) on our team, you'll work with a team of experts to create comprehensive test plans and documentation to support acquisition strategies for Navy surface, undersea, and cyber systems. You'll support the development and maintenance of Test and Evaluation Master Plans (TEMP) in accordance with DoW and Navy T&E guidance, policies, and templates. You'll use your experience to c

Full-time

USD 86,800.00 - 198,000.00 per year

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

McLean, Virginia

•

Today

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterprises leveraging AI. From

Full-time

AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory)

McLean, Virginia

•

Today

AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterp

Full-time

Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

McLean, Virginia

•

Today

Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterprises leveragin

Full-time

Launch Integration Engineer

Chantilly, Virginia

•

Today

Job ID: 2618275 Location: Chantilly, VA, US Date Posted: 2026-10-21 Category: Engineering and Sciences Subcategory: Specialty Engr Schedule: Full-Time Shift: Day Job Travel: Yes - 10% of the time Minimum Clearance Required: TS.SCI Clearance Level Must Be Able to Obtain: TS/SCI with Poly Potential for Remote Work: ORA_ON_SITE Description ?SAIC is seeking a Launch Integration Engineer to support national security space missions by integrating satellite programs with launch vehicle provid

Full-time

USD 120,001.00 - 160,000.00 per year

Test & Evaluation Engineer

Poolesville, Maryland

•

Today

F&A Technologies LLC, an emerging Service Disabled Veteran Owned Small Business, is seeking a Senior Test & Evaluation Engineer in Washington, DC (near Navy Yard) to provide Engineering Support Services to Engineers and Subject Matter Experts in support of the Conventional Prompt Strike (CPS) Program under the Department of Navy. Position is hybrid, onsite with occasional telework each week. The candidate will be supporting multiple engineering disciplines such as the following but not limited t

Full-time

Launch Integration Engineer

Chantilly, Virginia

•

Today

Job ID: 2616062 Location: Chantilly, VA, US Date Posted: 2026-08-25 Category: Engineering and Sciences Subcategory: Specialty Engr Schedule: Full-Time Shift: Day Job Travel: Yes - 25% of the time Minimum Clearance Required: TS.SCI_wPoly Clearance Level Must Be Able to Obtain: None Potential for Remote Work: ORA_ON_SITE Description SAIC is seeking a Launch Integration Engineer to support national security space missions by integrating satellite programs with launch vehicle providers. Th

Full-time

USD 80,001.00 - 120,000.00 per year

Senior ML / Evaluation Engineer

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

AI Automation Engineer

Hybrid in Vienna, Virginia

•

16d ago

Job Title: AI Test Engineer Location: Vienna, VA Type: Contract Work Model: Hybrid onsite and remote Hours: 40.0 Responsibilities Help design, develop, and maintain AI testing and evaluation frameworks for generative AI, predictive AI, and AI-powered developer experience (DevEx) solutions. Create and execute automated test suites that validate AI model behavior, output quality, accuracy, reliability, and performance. Develop automated evaluation pipelines that integrate with CI/CD workflows

Easy Apply

Contract

Depends on Experience

AI Agentic Engineer

Vienna, Virginia

•

14d ago

10+ years of AI/ML engineering experience, with at least 3 years building LLM-powered systems that have run in production with real users. Hands-on experience building agentic systems: tool use and function calling, multi-step and multi-agent workflows, orchestration frameworks, state and session management, and recovery from partial or failed tool calls. Demonstrated experience designing guardrails and policy enforcement for agents, scoped permissions, action gating, escalation to humans. St

Easy Apply

Contract

Depends on Experience

Nondestructive (NDT) Evaluation Engineer Level III Lead

Bethesda, Maryland

•

Today

Job Description Precise Systems delivers integrated, mission-ready solutions that advance warfighter readiness and strengthen our nation's most critical defense programs. Through the power of our combined capabilities, we provide deep expertise in Advanced Engineering; Digital Transformation; Electromagnetic Warfare; Interactive Training & Simulation; Physical Sciences Research; Platform Lifecycle Support; and Foreign Military Sales. Unified by decades of trusted performance and expanded throug

Full-time

USD 103,428.48 - 160,142.72 per year

Cybersecurity Test & Evaluation Specialist

Manassas, Virginia

•

Today

Basic Qualifications Bachelor's or Technology degree in Engineering or a related specialized area/field, or equivalent combination of education and relevant work experience, plus 5 years of relevant experience; or Master's degree plus 3 years of experience. CLEARANCE REQUIREMENTS: Department of Defense Secret security clearance is required at time of hire. Applicants selected will be subject to a U.S. Government security investigation and must meet eligibility requirements for access to classi

Full-time

USD 111,493.00 - 123,687.00 per year

Senior Test and Evaluation Engineer

Washington, District of Columbia

•

Today

The Senior Test and Evaluation Engineer will support a high-profile Air Force customer at Joint Base Anacostia-Bolling, DC. The customer organization is responsible for capability development and development planning. The Test and Evaluation Engineer will work with internal and external stakeholders to plan, execute, assess, and document Developmental Testing (DT) and Operational Testing (OT) of tactical command and control (C2) systems. Some travel is expected (up to 20%). Responsibilities: S

Full-time

USD 150,000.00 - 220,000.00 per year

Research Professorial Open Rank, AI Test and Evaluation

Arlington, Virginia

•

Today

Job Description The Virginia Tech National Security Institute (VTNSI) is a national leader in advancing security and resilience through innovative and applied research, empowering the next generation of experts, and building strategic alliances to address evolving national security challenges. We bring together exceptional interdisciplinary faculty, unique research infrastructure, and deep partnerships with industry and government sponsors to execute impactful research and development. VTNSI se

Full-time

USD 150,000.00 per year

Test & Evaluation Engineer

Washington, District of Columbia

•

Today

Overview VTG is seeking a Mid to Senior Test & Evaluation Engineer at the Washington, DC Navy Yard to provide Engineering Support Services to Engineers and Subject Matter Experts in support of the Conventional Prompt Strike (CPS) Program under the Department of Navy. Position is mostly onsite with occasional telework. The candidate will be supporting multiple engineering disciplines such as the following but not limited to: Mechanical, Electrical, Systems, Information Systems, Navigation, Fligh

Full-time

USD 100,000.00 - 160,000.00 per year

Operational Test and Evaluation Engineer SME

Washington, District of Columbia

•

Today

Overview Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and practice, producing Results that Matter. Come work with the best! We offer opportunity, unique challenges, and clear-sighted commitment to

Full-time

USD 140,000.00 per year

Evaluation jobs in Ashburn, VA, USA