Apply Now

VLM Engineer

Herndon, VA, US • Posted 1 day ago • Updated 10 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

Language Models
Orchestration
Reasoning
Collaboration
Security Clearance
FOCUS
Deep Learning
Python
Amazon Web Services
GPU
Amazon EC2
Benchmarking
Adapter
Management
PyTorch
Transformer
Software Engineering
Version Control
Continuous Integration
Continuous Delivery
Testing
Remote Sensing
SAR
Satellite
Geospatial Analysis
Meta-data Management
Optimization
Machine Learning Operations (ML Ops)
Amazon SageMaker
Active Learning
CGI
Workflow
Docker
Elasticsearch
NIST 800-53
Regulatory Compliance
Machine Learning (ML)
Adobe AIR
Evaluation
Publications
Computer Vision
Training
Artificial Intelligence
Biometrics
Spectrum
Business Process

Summary

This is role is anticipating to end at the end of July, with expectation of mod/additional funding through 2027.

Responsibilities

Design and execute fine-tuning pipelines for Vision-Language Models (VLMs) on domain-specific imagery datasets, including data preprocessing, training orchestration, and hyperparameter optimization
Develop and implement evaluation frameworks for multimodal model performance, including task-specific metrics for image understanding, visual question answering, and spatial reasoning
Build scalable training infrastructure on AWS (SageMaker, EC2 GPU instances) for distributed fine-tuning of large multimodal models
Engineer data pipelines for curating, annotating, and transforming geospatial imagery datasets into model-ready formats for supervised and instruction-tuning workflows
Collaborate with applies scientists and solutions architects to iterate on model architectures, adapter strategies (LoRA/QLoRA), and inference optimization techniques

Requirements

TS/SCI CI Poly Clearance with current NGA eligibility and SBU/SecNet/COE accounts
Must be willing to work in SCIF daily or as needed
5+ years of professional machine learning engineering experience with a focus on deep learning
4+ years of advanced Python development for ML workloads
3+ years of experience with computer vision or multimodal models
3+ years of experience with AWS ML infrastructure
SageMaker Training jobs, Processing jobs, and endpoint deployment
GPU instance selection, multi-node training, and cost optimization on EC2 (P4/P5/G5/G6e)
2+ years of experience building ML evaluation pipelines
Automated benchmarking, metric computation, and result analysis
Experience with both quantitative metrics and qualitative/human evaluation approaches
1+ years of hands-on experience fine-tuning large foundation models (LLMs or VLMs)
Experience with parameter-efficient fine-tuning methods (LoRA, QLoRA adapters)
Familiarity with supervised fine-tuning, instruction tuning, and RLHF/DPO alignment techniques
Strong proficiency with PyTorch and the HuggingFace ecosystem (Transformers, PEFT, Datasets, Accelerate)
Experience with distributed training frameworks (DeepSpeed, FSDP, or Megatron)
Understanding of vision transformer architectures (ViT, CLIP, LLaVA-family models, or similar)
Experience processing and augmenting image datasets at scale
Strong software engineering fundamentals (version control, CI/CD for ML workflows, testing)

Desired Skills

2+ years of experience with geospatial or remote sensing imagery
2+ years of experience with Authority to Operate (ATO) processes in government environments
Familiarity with electro-optical and SAR satellite imagery formats and characteristics
Understanding of geospatial metadata, coordinate systems, and imagery preprocessing
Experience with model quanitzation and inference optimization (vLLM, TensorRT, ONNX)
Experience with MLOps and experiment tracking tools (MLflow, Weights & Biases, SageMaker Experiements)
Familiarity with data annotation platforms and active learning workflows for imagery
Experience with containerized ML workflows (Docker, ECR, ES/EKS)
Implementation of NIST 800-53 controls and security compliance for ML systems
Experience deploying models in air-gapped or disconnected environments
Familiarity with multimodal evaluation benchmarks (MMMU, MMBench, GQA, or domain-specific equivalents)
Publications or demonstrated contributions in computer vision, VLMs, or multimodal AI
Experience with synthetic data generation for training data augmentation

About Us
For more than 20 years, NewGen Technologies has solved our clients' toughest IT challenges with integrity, security, and outstanding service by delivering both technology and talent. We have helped secure borders, have used artificial intelligence (AI) to fight terror, aided the identification of criminals, and have helped to prevent crime through the introduction of biometrics. Our team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10153280
Position Id: 271a27eea495644afe71b1221e0372bc
Posted 1 day ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Software Engineer II

Herndon, Virginia

•

Today

Job Description: Quevera is seeking a Software Engineer II to join our team. At Quevera, we don't just offer jobs-we provide opportunities to be part of a dynamic, forward-thinking community that fosters innovation, collaboration, and personal growth. You'll work with industry experts, take on exciting challenges, and have the creative freedom to build cutting-edge solutions, all while advancing your career in a space that truly values your skills and ideas. HIGHLIGHT'S OF WORKING FOR QUEVERA:

Full-time

Data Scientist / AI/ML Engineer (Imagery) VAWFH 1652

Reston, Virginia

•

Today

Clearance Level: TS/SCI ship: Required Job Classification: Regular, Full-Time Location: Reston, VA Years of Experience: 5-7 Years Education Level:Bachelor degree or Master s degree is required in Operations Research, Industrial Engineering, Applied Mathematics, Statistics, Physics, Computer Science, or related fields. Briefly Describe the Work: GITI is looking for a Machine Learning (ML) Engineer with documented expertise to be responsible for researching, developing, architecting, and int

Full-time

MLOps Engineer

Remote or McLean, Virginia

•

Today

Job Family: Data Science & Analysis Travel Required: Up to 25% Clearance Required: Active Secret What You Will Do: As an MLOps Engineer, you will design, implement, and support the platforms, pipelines, and operational processes that enable scalable, secure, and reliable deployment of machine learning solutions for federal clients. You will partner closely with data scientists, AI engineers, data engineers, and government stakeholders to operationalize models across development, testing, and

Full-time

USD 113,000.00 - 188,000.00 per year

Mid MLOps Engineer

Chantilly, Virginia

•

Today

Job Number: R0241240 MLOps Engineer, Mid The Opportunity: Are you looking for an opportunity to make a difference and help build a system that will have a positive impact in the intelligence community (IC)? What if you could find a position that is tailor made for your mix of development, engineering, and analytics? Efficient development teams make the most of their time by limiting the activities that take developers and data scientists away from writing their code. That's why we need you, an

Full-time

USD 77,600.00 - 176,000.00 per year

Search all similar jobs