AI Developer - Black Rock Group - Washington D.C., DC, US | Dice.com

Black Rock Group

Apply Now

AI Developer

Washington D.C., DC, US • Posted 7 hours ago • Updated 7 hours ago

Contract W2

On-site

Depends on Experience

Apply Now

Black Rock Group

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

AI Developer
AI Engineer
RAG
MCP
Agentic AI
Azure OpenAI
Model Context Protocol

Summary

Title: AI Developer
Location: Washington, DC (Hybrid Onsite 4 days/week from Day 1; transitioning to 100% onsite soon)
Interview: Phone / Skype

Note: No Data Scientists or Architects. Need hands-on AI Developer / AI Engineer with experience in RAG, MCP, Agentic AI, and Azure OpenAI.

Job Description

The World Bank is seeking an experienced AI Developer to design and deliver advanced RAG systems, Model Context Protocol (MCP) tools, and agentic AI solutions leveraging Azure OpenAI and modern agent frameworks. This role requires strong hands-on development skills not theoretical or research-only experience.

Key Responsibilities

Design, build, and operate Retrieval-Augmented Generation (RAG) services using Azure AI/Search
(chunking, embeddings, re-ranking, evaluation, citation generation).
Develop and deploy Model Context Protocol (MCP) tools/servers integrating with security scanners, inventory systems, approvals workflows, and Azure DevOps/GitHub.
Build agentic AI systems using AutoGen, CrewAI, and/or Agno with secure tool-calling and multi-agent orchestration.
Develop production-grade chatbots (multi-turn, retrieval-grounded) including prompt management, guardrails, audit logging, and telemetry.
Integrate Azure OpenAI behind APIM, manage secrets in Key Vault, connect events via Event Hub, and implement observability with App Insights / Log Analytics.
Evaluate and fine-tune open-source models using PEFT/LoRA while balancing cost, latency, and safety.
Implement CI/CD pipelines in Azure DevOps, unit/integration testing, red-team validation (prompt injection & jailbreaks), and operational runbooks.

Minimum Qualifications

4 8 years total software development experience, including 2+ years in applied LLM/GenAI.
Strong Python development skills.
Hands-on experience with Azure OpenAI and Azure AI/Search (vector search, hybrid search, semantic ranking).
Practical experience with agent frameworks: AutoGen, CrewAI, Agno, and MCP/tool-use architecture.
Strong Azure PaaS experience: Azure Functions/Web Apps, APIM, Key Vault, Event Hub, secure API design, Entra ID/RBAC.
Observability experience using App Insights, Log Analytics/KQL.
CI/CD experience with Azure DevOps.

Nice to Have

Experience with RAG evaluation frameworks (e.g., Ragas), golden datasets, Cosmos DB, advanced KQL.
Strong security mindset: prompt-injection defenses, content safety, data privacy controls, threat modeling.
Experience in optimizing LLM workloads: latency reduction, cost management, throughput tuning.

Preferred Certifications

Microsoft Certified: Azure AI Engineer Associate (AI-102)
Microsoft Certified: Azure Developer Associate (AZ-204)
Microsoft Certified: Azure Solutions Architect Expert (AZ-305)
Microsoft Certified: Azure Data Scientist Associate (DP-100)

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91166696
Position Id: 8829542
Posted 7 hours ago

Company Info

About Black Rock Group

At Black Rock Groups Inc, we specialize in providing top-tier human resource services tailored to meet the evolving needs of businesses across the United States. Our expertise spans talent acquisition, workforce management, employee engagement, compliance, and strategic HR consulting.

We empower organizations by delivering customized HR solutions that drive efficiency, productivity, and long-term growth. Whether you're a startup looking to build a strong team or an enterprise seeking to optimize workforce strategies, our dedicated professionals are here to support your business success.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Azure AI Developer

Washington, District of Columbia

•

13d ago

Onsite Washington DC Only W2 No Corp to Corp Open to Sponsorship Minimum Qualifications 5-10 years total software development experience, with 2+ years in applied LLM/GenAI.Strong Python skills and hands-on experience with Azure OpenAI and Azure AI/Search (vector search, hybrid search, semantic ranking).Practical experience with agent frameworks (AutoGen, CrewAI, Agno) and MCP/tool-use patterns.Proven Azure PaaS experience: Azure Functions or Web Apps, APIM, Key Vault, Event Hub; familiarity wi

Easy Apply

Contract

Depends on Experience

Azure AI Developer

Hybrid in Washington, District of Columbia

•

23d ago

Role: AI Developer Location: Washington, DC Duration: 5 Months Hybrid Onsite: 4 days per week from Day 1 Key Responsibilities Design, implement, and operate Retrieval-Augmented Generation (RAG) services using Azure AI/Search, including chunking, embeddings, re-ranking, evaluation, and citation display. Design and deploy Model Context Protocol (MCP) tools/servers to integrate security scanners, inventory systems, approvals, and Azure DevOps/GitHub services. Build agentic AI solutions using Auto

Easy Apply

Contract, Third Party

Depends on Experience

AI Developer

Hybrid in Washington, District of Columbia

•

19d ago

Role: AI Developer Location: Washington, DC Duration: 5 Months Hybrid Onsite: 4 days per week from Day 1, with a full transition to 100% onsite anticipated soon. Key Responsibilities Design, implement, and operate Retrieval-Augmented Generation (RAG) services using Azure AI/Search, including chunking, embeddings, re-ranking, evaluation, and citation display. Design and deploy Model Context Protocol (MCP) tools/servers to integrate security scanners, inventory systems, approvals, and Azure DevOp

Easy Apply

Contract, Third Party

$60 - $70

Developer - AI Engineer

Hybrid in Washington, District of Columbia

•

9d ago

Looking for an AI Engineer for a 7 month contract with possible long term extension. AI Engineer: The AI Engineer will play a pivotal role in designing, developing, and deploying artificial intelligence solutions that enhance operational efficiency, automate decision-making, and support strategic initiatives for the environmental and social specialists within the client. This role is central to the VPU s digital transformation efforts and will contribute to the development of scalable, ethical,

Easy Apply

Third Party, Contract

Depends on Experience

AI Developer

Black Rock Group

Dice Job Match Score™

Dice Job Match Score™

Job Details

Skills

Summary

Company Info

About Black Rock Group

Similar Jobs

Dice Job Match Score™

Aditya Singh