LLM Evaluation jobs in McLean, VA

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

2d ago

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

Senior AI/LLM Optimization Engineer

Hybrid in McLean, Virginia

•

Today

Data Capital Inc. is seeking a highly experienced AI/LLM Optimization Engineer to optimize production-grade Generative AI applications for accuracy, performance, scalability, and reliability. This is a hands-on engineering rolenot a prompt engineering or POC-focused position. Key ResponsibilitiesOptimize enterprise LLM applications, RAG pipelines, and AI agents. Improve model accuracy, response quality, throughput, and inference latency. Implement advanced RAG techniques, embeddings, hybrid sear

Easy Apply

Full-time

Depends on Experience

AI Automation Engineer

Hybrid in Vienna, Virginia

•

18d ago

Job Title: AI Test Engineer Location: Vienna, VA Type: Contract Work Model: Hybrid onsite and remote Hours: 40.0 Responsibilities Help design, develop, and maintain AI testing and evaluation frameworks for generative AI, predictive AI, and AI-powered developer experience (DevEx) solutions. Create and execute automated test suites that validate AI model behavior, output quality, accuracy, reliability, and performance. Develop automated evaluation pipelines that integrate with CI/CD workflows

Easy Apply

Contract

Depends on Experience

Senior Software Engineer, AI Evaluation (Python / TypeScript / Go), Remote Contract

Remote

•

Yesterday

Remote contract work for senior engineers: design rubrics and evaluation criteria for coding AI, review and label model output, and build data generation and evaluation pipelines. 5+ years hands-on Python, TypeScript, Go or JavaScript- Strong background building and maintaining pipelines and infrastructure- Rubric or preference-data experience is a plus- 20 to 40 hours a week with 4 hours overlapping US Pacific time; 3-month contract, immediate start- Top-of-market pay: up to $90+/hr for the mo

Contract

Depends on Experience

EOIR Program Manager - AI TESTING

Alexandria, Virginia

•

30+d ago

Job Title: EOIR Program Manager - AI TESTING Location: Alexandria, VA Type: Contract Compensation: $150,000.00-160,000.00 USD Work Model: Onsite onsite Hours: 40.0 Security Clearance: Must be able to obtain and maintain a DOJ Public Trust level security clearance (candidates with an active or recently active Tier 2 or higher clearance are strongly preferred). Responsibilities Plan, initiate, and manage all IT/AI project activities across SOW Task Areas 1-5, monitoring progress to ensure

Easy Apply

Contract

$200000

AI Engineer - Senior

Chantilly, Virginia

•

Today

At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations. Join Accenture Federal Services, a technology company within global Accenture. Recognized as a Glassdoor Top 100 Best Place to

Full-time

USD 94,000.00 - 187,600.00 per year

AI/LLM Developer

Arlington, Virginia

•

Today

Residency All applicants must currently reside in the United States Overview BigBear.ai is seeking a Mid-Level AI/LLM Developer to support the development and implementation of AI-focused initiatives and pilot efforts supporting the Transportation Security Administration (TSA). This role will contribute to the development of AI-enabled capabilities from concept through implementation and will work closely with technical and functional teams to design, develop, test, integrate, and deploy solut

Full-time

Reverse Engineer/Software Tester

Arlington, Virginia

•

Today

Overview Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and practice, producing Results that Matter. Come work with the best! We offer opportunity, unique challenges, and clear-sighted commitment to

Full-time

USD 150,000.00 - 250,000.00 per year

Artificial Intelligence Engineer (Multiple Levels)

McLean, Virginia

•

Today

Responsibilities Noblis is seeking an Artificial Intelligence (AI) Engineer to work in dynamic mission-oriented environment within McLean, Virginia. As an AI Engineer you will work with mission users to understand requirements, and partner with data engineers to transform complex datasets into actionable insights, automate analyst workflows, and deliver scalable, reliable AI capabilities aligned with mission objectives. Job Responsibilities: Collaborate directly with mission users and stakehol

Full-time

USD 90,700.00 - 141,775.00 per year

Data Scientist

Herndon, Virginia

•

Today

We are an employee-centric company that truly values our team members and the contributions they make to our customers and the missions they support. We pride ourselves on being forward-leaning thinkers and on building teams that are, and continue to be, technically proficient across a broad range of cyber mission areas. OneZero full-time employees receive a highly competitive benefits package, including health, dental, vision, and life insurance, a 401(k) with company matching, paid time off an

Full-time

USD 70,000.00 - 85,000.00 per year

AI/ML Data Scientist

McLean, Virginia

•

26d ago

Job Title: AI/ML Data Scientist Location: 100% REMOTE Clearance: Ability to obtain and maintain a Public Trust clearance. Type: Contract-to-hire Contact: WHAT YOU WILL DO: Partner with stakeholders to define and deliver AI, machine learning, and advanced analytics use cases, translating business needs into scalable data science solutions.Design and develop machine learning models and analytical approaches to support search, discovery, anomaly detection, fraud detection, and insight generation ac

Easy Apply

Contract

Depends on Experience

Senior Manager Enterprise AI Orchestration Architect

Hybrid in McLean, Virginia

•

Today

Job Number: R0251883 Enterprise AI Orchestration Architect, Senior Manager The Opportunity: In this role, you'll build reusable agents and intelligent applications that perform enterprise work reliably. You will develop agent behavior, orchestration, tool integrations, and evaluation capabilities that support customer solutions from demonstration through production. You will translate workflows into tested software using model APIs, retrieval, tool calling, memory, and human oversight. You wil

Full-time

USD 162,800.00 - 303,000.00 per year

Data Scientist

Washington, District of Columbia

•

Today

Job Description ABS Group is seeking a Data Scientist to join our Artificial Intelligence Practice in support of a major federal modernization program. In this role, you will apply machine learning, statistical analysis, and modern AI techniques to large, complex datasets that support mission-critical planning and operations. You will work alongside data scientists, engineers, and client stakeholders to build analytical solutions that improve data quality, support decision-making, and help move

Full-time

Applied Researcher 4 (AI Foundations: Recommendation Systems)

McLean, Virginia

•

Today

Applied Researcher 4 (AI Foundations: Recommendation Systems) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent, automated customer experiences. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to building

Full-time

Applied Researcher 4 (AI Foundations)

McLean, Virginia

•

Today

Applied Researcher 4 (AI Foundations) Overview: At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent, automated customer experiences. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to building world-class app

Full-time

Applied Researcher 5 (AI Foundations, LLM Core and Agentic AI)

McLean, Virginia

•

Today

Applied Researcher 5 (AI Foundations, LLM Core and Agentic AI) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent, automated customer experiences. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to building

Full-time

Applied Researcher 4 (AI Foundations, LLM Core and Agentic AI)

McLean, Virginia

•

Today

Applied Researcher 4 (AI Foundations, LLM Core and Agentic AI) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent, automated customer experiences. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to building

Full-time

Applied Researcher 4 (AI Foundations, LLM Customization and Finetuning)

McLean, Virginia

•

Today

Applied Researcher 4 (AI Foundations, LLM Customization and Finetuning) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent, automated customer experiences. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to

Full-time

AI Delivery Engagement Lead (FS Poly Required)

McLean, Virginia

•

Today

August Schell is looking for an AI Delivery Engagement Lead to sit at the front edge of an Intelligence Community customer's adoption of commercial AI. This is the seat between a fast-moving AI platform and the mission users who have to trust it: you scope the use cases, run the delivery, and own the relationship - translating what the analysts actually need into what the platform actually does, and back again. This is not a data-science bench role and it is not a project-administration role. It

Full-time

Generative AI Engineer (Clearance Required)

Arlington, Virginia

•

Today

InterImage is looking for engineers who thrive where innovation meets execution. Our Product Division rapidly transforms emerging technologies into operational capabilities supporting mission-critical customers. This isn't a research-only position. You'll take Generative AI concepts from proof of concept to production, designing, developing, deploying, and continuously improving AI-powered applications that solve real-world operational problems. If you enjoy building with the latest LLMs, experi

Full-time

LLM Evaluation jobs in McLean, VA, USA