Evaluation jobs in Beltsville, MD

Research Lead - AI Cyber Testing & Evaluation

Hybrid in Washington, District of Columbia

•

Today

Job Type: Term (Fixed Term) Position Description RAND's Center on AI, Security, and Technology (CAST) , part of the Global and Emerging Risks (GER) Division conducts cutting-edge research on transformative, high-impact technologies-including artificial intelligence and biotechnology-to shape policies that protect global security and advance the public good. You will be responsible for managing significant research budgets and personnel, overseeing complex technical research and policy analysis

Full-time

USD 150,100.00 - 268,500.00 per year

Test and Evaluation Engineer

Washington, District of Columbia

•

Today

Job Number: R0251169 Test and Evaluation Engineer The Opportunity: As a Test and Evaluation (T&E) Subject Matter Expert (SME) on our team, you'll work with a team of experts to create comprehensive test plans and documentation to support acquisition strategies for Navy surface, undersea, and cyber systems. You'll support the development and maintenance of Test and Evaluation Master Plans (TEMP) in accordance with DoW and Navy T&E guidance, policies, and templates. You'll use your experience to c

Full-time

USD 86,800.00 - 198,000.00 per year

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

McLean, Virginia

•

Today

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterprises leveraging AI. From

Full-time

AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory)

McLean, Virginia

•

Today

AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterp

Full-time

Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

McLean, Virginia

•

Today

Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterprises leveragin

Full-time

Test and Evaluation Data Analyst

National Harbor, Maryland

•

Today

Job Title: Test and Evaluation Data Analyst Job Category: Engineering and Technical Support Time Type: Full time Minimum Clearance Required to Start: None Employee Type: Regular Percentage of Travel Required: None Type of Travel: None * * * The Opportunity: CACI is seeking a Test and Evaluation Data Analyst to join our team. As a Compliance Tester, you will be responsible for the 508-compliance testing, usability testing, and quality testing for a FEMA web-based products and content. In

Full-time

USD 78,700.00 - 165,200.00 per year

Test & Evaluation Engineer

Poolesville, Maryland

•

Today

F&A Technologies LLC, an emerging Service Disabled Veteran Owned Small Business, is seeking a Senior Test & Evaluation Engineer in Washington, DC (near Navy Yard) to provide Engineering Support Services to Engineers and Subject Matter Experts in support of the Conventional Prompt Strike (CPS) Program under the Department of Navy. Position is hybrid, onsite with occasional telework each week. The candidate will be supporting multiple engineering disciplines such as the following but not limited t

Full-time

Senior ML / Evaluation Engineer

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

3d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

AI Automation Engineer

Hybrid in Vienna, Virginia

•

17d ago

Job Title: AI Test Engineer Location: Vienna, VA Type: Contract Work Model: Hybrid onsite and remote Hours: 40.0 Responsibilities Help design, develop, and maintain AI testing and evaluation frameworks for generative AI, predictive AI, and AI-powered developer experience (DevEx) solutions. Create and execute automated test suites that validate AI model behavior, output quality, accuracy, reliability, and performance. Develop automated evaluation pipelines that integrate with CI/CD workflows

Easy Apply

Contract

Depends on Experience

Alarm Service Technician I

Laurel, Maryland

•

Today

Description Brinks Home? is a leader in the smart security industry, protecting over one million people across the U.S., Canada, and Puerto Rico. Our platinum-grade protection is backed by award-winning customer service and expertly trained professionals. We strive for the highest standards for our customers while fostering a positive work environment for our employees. We create a culture that fosters innovation, celebrates creativity, and encourages authenticity. Join us and be part of a colla

Full-time

Alarm Service Technician I

Silver Spring, Maryland

•

Today

Full-time

Senior Test and Evaluation Engineer

Washington, District of Columbia

•

Today

The Senior Test and Evaluation Engineer will support a high-profile Air Force customer at Joint Base Anacostia-Bolling, DC. The customer organization is responsible for capability development and development planning. The Test and Evaluation Engineer will work with internal and external stakeholders to plan, execute, assess, and document Developmental Testing (DT) and Operational Testing (OT) of tactical command and control (C2) systems. Some travel is expected (up to 20%). Responsibilities: S

Full-time

USD 150,000.00 - 220,000.00 per year

Nondestructive (NDT) Evaluation Engineer Level III Lead

Bethesda, Maryland

•

Today

Job Description Precise Systems delivers integrated, mission-ready solutions that advance warfighter readiness and strengthen our nation's most critical defense programs. Through the power of our combined capabilities, we provide deep expertise in Advanced Engineering; Digital Transformation; Electromagnetic Warfare; Interactive Training & Simulation; Physical Sciences Research; Platform Lifecycle Support; and Foreign Military Sales. Unified by decades of trusted performance and expanded throug

Full-time

USD 103,428.48 - 160,142.72 per year

Test & Evaluation Engineer

Washington, District of Columbia

•

Today

Overview VTG is seeking a Mid to Senior Test & Evaluation Engineer at the Washington, DC Navy Yard to provide Engineering Support Services to Engineers and Subject Matter Experts in support of the Conventional Prompt Strike (CPS) Program under the Department of Navy. Position is mostly onsite with occasional telework. The candidate will be supporting multiple engineering disciplines such as the following but not limited to: Mechanical, Electrical, Systems, Information Systems, Navigation, Fligh

Full-time

USD 100,000.00 - 160,000.00 per year

Operational Test and Evaluation Engineer SME

Washington, District of Columbia

•

Today

Overview Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and practice, producing Results that Matter. Come work with the best! We offer opportunity, unique challenges, and clear-sighted commitment to

Full-time

USD 140,000.00 per year

Research Professorial Open Rank, AI Test and Evaluation

Arlington, Virginia

•

Today

Job Description The Virginia Tech National Security Institute (VTNSI) is a national leader in advancing security and resilience through innovative and applied research, empowering the next generation of experts, and building strategic alliances to address evolving national security challenges. We bring together exceptional interdisciplinary faculty, unique research infrastructure, and deep partnerships with industry and government sponsors to execute impactful research and development. VTNSI se

Full-time

USD 150,000.00 per year

Software Test & Evaluation Engineer

Maryland

•

Today

Leidos has a new and exciting opportunity for a Software Test & Evaluation Engineer in our Intel Sector. Our talented team is at the forefront in Security Engineering, Computer Network Operations (CNO), Mission Software, Analytical Methods and Modeling, Signals Intelligence (SIGINT), and Cryptographic Key Management. At Leidos, we offer competitive benefits, including Paid Time Off, 11 paid Holidays, 401K with a 6% company match and immediate vesting, Flexible Schedules, Discounted Stock Purchas

Full-time

USD 92,300.00 - 166,850.00 per year

Evaluation jobs in Beltsville, MD, USA