Job Number: R0251615 RAG Application Engineer
The Opportunity: Retrieval-Augmented Generation (RAG) systems require reliable, well-orchestrated runtime logic to integrate search, models, and metadata into a single coherent experience. As a RAG Application Engineer, you will build the application layer that makes this possible. You will implement the end-to-end query workflow, including embedding generation, hybrid retrieval, reranking, citation assembly, and request-level guardrails, ensuring analysts can access grounded, high-quality responses at scale.
We're looking for an engineer who can design and maintain RAG runtime logic in a secure, cloud-based environment. On our team, you'll develop API endpoints, manage model integrations, enforce authentication and authorization controls, and implement robust retry, timeout, and error-handling strategies.
You'll containerize services and partner closely with Cloud, Security, Data, and Site Reliability Engineering teammates to ensure the RAG runtime is stable, secure, observable, and ready for mission use.
Join us. The world can't wait.
You Have: - Experience building back-end or platform services using programming languages such as Python or Java
- Experience designing or integrating RAG workflows, including embeddings, hybrid retrieval, vector search, and reranking
- Experience implementing API request pipelines, orchestration logic, and service routing for AI model and search calls
- Experience enforcing authentication and authorization within service logic
- Experience developing resilient services with retry, backoff, timeout, and error-handling strategies and collaborating with data, search, cloud, and security engineers to optimize retrieval behavior
- Experience containerizing applications using Docker and deploying to ECS, EKS, or Kubernetes
- Experience building telemetry, including structured logs, metrics, and traces
- Ability to translate RAG requirements into clean, maintainable application logic
- TS/SCI clearance
- HS diploma or GED
Nice If You Have: - Experience integrating Amazon Bedrock model inference into application workflows
- Experience implementing hybrid retrieval with OpenSearch, including BM25 and vector search
- Experience developing citation assembly logic, grounding validation, or model guardrails
- Experience designing API gateways, rate limiting, caching, or other high-availability patterns
- Experience working with message queues or asynchronous workflows, including Kafka or Amazon SQS
- Experience contributing to evaluation data pipelines or partnering with evaluation scientists
- Experience using infrastructure-as-code frameworks such as Terraform, CloudFormation, or AWS CDK
- Ability to collaborate across multiple engineering disciplines
- Possession of excellent communication skills
Clearance: Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; TS/SCI clearance is required.
Skills Assessment As part of Booz Allen's skills first hiring process, candidates must complete the required skills assessment to ensure they meet the Basic Qualifications for this role. Candidates must complete the assessment and meet the minimum proficiency threshold to continue in the hiring process.
CompensationAt Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.
Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $69,400.00 to $158,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date.
Identity StatementAs part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.
Candidate AI Usage PolicyAI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on
your own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited
unless permission is explicitly provided.
Work ModelOur people-first culture prioritizes the benefits of collaboration. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings.
- Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.
- Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen or customer facility, in alignment with your leadership's expectations and the needs of the role.
- Onsite: If this position is listed as onsite, work will primarily be performed full-time at a customer facility, where employees will collaborate directly with colleagues and customers as required by the role.
Commitment to Non-DiscriminationAll qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.
