AI Agentic Engineer

Vienna, VA, US • Posted 8 hours ago • Updated 8 hours ago
Contract W2
Contract Independent
12 Months
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Machine Learning (ML)
  • A/B Testing
  • Evaluation
  • Orchestration
  • Generative Artificial Intelligence (AI)
  • Workflow
  • Vector Databases
  • Amazon Web Services
  • Management
  • Continuous Integration
  • Artificial Intelligence
  • Recovery

Summary

·       10+ years of AI/ML engineering experience, with at least 3 years building LLM-powered systems that have run in production with real users.

·       Hands-on experience building agentic systems: tool use and function calling, multi-step and multi-agent workflows, orchestration frameworks, state and session management, and recovery from partial or failed tool calls.

·       Demonstrated experience designing guardrails and policy enforcement for agents, scoped permissions, action gating, escalation to humans.

·       Strong RAG fundamentals: chunking, embeddings, vector databases, indexing, and re-ranking, with a track record of diagnosing and measurably improving retrieval quality.

·       Demonstrated experience evaluating GenAI systems quantitatively: golden/labeled datasets, offline and online eval pipelines, LLM-as-judge scoring paired with human review, regression and A/B testing.

·       Hands-on experience with GenAI evaluation and observability tooling (e.g., Ragas, DeepEval, LangSmith/Langfuse, Amazon Bedrock model evaluation, MLflow), including running evals in CI and tracking metrics over time.

·      

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10122314
  • Position Id: agenticeng
  • Posted 8 hours ago
Contact the job poster
DA

Dipika Anand

Recruiter @ Quality IT Source, LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Rockville, Maryland

Today

Easy Apply

Contract

59 - 60

Washington, District of Columbia

Today

Easy Apply

Full-time

$180000 - $270000

Remote

11d ago

Easy Apply

Contract, Third Party

Depends on Experience

Remote

Today

Full-time

USD 130,000.00 - 200,000.00 per year

Search all similar jobs