Apply Now

AI/ML Test Engineer

Springfield, VA, US • Posted 4 hours ago • Updated 4 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

Recruiting
Integration Testing
Collaboration
Technical Writing
Reporting
Decision-making
System Integration
Automated Testing
Data Validation
Analytical Skill
Communication
DoD
Testing
Agile
DevSecOps
Cloud Computing
Workflow
Artificial Intelligence
Machine Learning (ML)
Evaluation
Security Clearance
PASS
Continuous Integration

Summary

Modern Technology Solutions, Inc. (MTSI) is hiring an AI/ML Test Engineer in Springfield, VA.

Responsibilities:

Execute system-level AI/Machine Learning evaluation activities within the Test & Evaluation (T&E) environment supporting mission-focused operational testing.
Perform integration testing, data capture, drift detection, and operational validation activities across AI/ML evaluation workflows.
Support automated and semi-automated evaluation pipelines for AI/ML model testing and performance assessment.
Develop, maintain, and refine data annotation workflows supporting operational evaluation requirements.
Validate operational datasets and support testing activities across multiple models, datasets, and mission scenarios.
Conduct integration testing of AI/ML models within operationally representative environments and workflows.
Adapt evaluation procedures and workflows to address evolving GEOINT data conditions and operational mission requirements.
Support high-throughput and parallel model evaluation activities to maintain alignment with mission timelines and operational priorities.
Identify and mitigate data drift, performance degradation, and workflow issues impacting evaluation reliability.
Collaborate with Senior AI/ML Test Engineers, data scientists, software engineers, and mission stakeholders to support scalable T&E execution.
Contribute to technical documentation, evaluation reporting, and customer briefings supporting operational decision-making.

Qualifications Required:

4+ years of experience supporting AI/ML testing, system integration, operational testing, or evaluation workflows.
Familiarity with automated testing pipelines, operational data validation, and model performance assessment concepts.
Ability to support multiple evaluation activities across dynamic operational environments.
Experience troubleshooting technical workflow or data-related issues in support of operational objectives.
Strong analytical, organizational, and communication skills.

Education Requirements:

Bachelor's degree in IT or STEM related field, or additional relevant experience in lieu of a degree.

Desired Qualifications:

Experience supporting DoD, NGA, or Intelligence Community programs.
Familiarity with AI/ML model evaluation, GEOINT workflows, and operational testing environments.
Experience working in Agile, DevSecOps, or cloud-based operational environments.
Familiarity with annotation workflows, data capture pipelines, drift detection, and automated evaluation tools.
Experience supporting scalable AI/ML evaluation or mission-focused T&E activities.

Clearance Requirements:

Active TS/SCI clearance and the ability to pass a CI polygraph within 30 days.

#LI-RC2

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: RTL041421
Position Id: 3f9f95bbc93049e643475a0f4c264909
Posted 4 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Software Engineer

Springfield, Virginia

•

Today

Modern Technology Solutions, Inc. (MTSI) is hiring a Senior Software Engineer in Springfield, VA. Responsibilities: Support AI/ML Test & Evaluation (T&E) activities for mission-critical national security programs.Leads the development and maintenance of the technical and process foundation required for consistent, traceable, and repeatable execution of MT&E, ST&E, and HMTT&E activities across the program.Design and implement the operational ST&E environment by provisioning virtual infrastructur

Full-time

Software Engineer

Springfield, Virginia

•

Today

Modern Technology Solutions, Inc. (MTSI) is hiring a Software Engineer in Springfield, VA. Responsibilities: Develop custom GEOINT software scripts and utilities supporting AI/ML T&E pipelines and operational evaluation workflows.Support automation of data processing, operational testing, and model evaluation activities across multiple mission environments.Create lightweight tooling to address unique operational requirements and evolving AI/ML evaluation needs.Support integration of custom scri

Full-time

Senior AI/ML Engineer

Alexandria, Virginia

•

Today

This Department of War enterprise data and analytics program delivers mission-critical capabilities that enable leaders across the Department to make faster, better-informed decisions using trusted data at scale. Leidos Digital Modernization sector is seeking an experienced Senior AI/ML Engineer to support the delivery, enhancement, and adoption of enterprise data and analytics products used across multiple DoD organizations. In this role, you will work alongside government partners, engineers,

Full-time

USD 107,900.00 - 195,050.00 per year

TEVV/ AI Assurance Engineer

Arlington, Virginia

•

Today

At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations. Join Accenture Federal Services, a technology company within global Accenture. Recognized as a Glassdoor Top 100 Best Place to

Full-time

USD 100,200.00 - 203,400.00 per year

Search all similar jobs

More jobs at Modern Technology Solutions in Springfield, VA