Backend AI Engineer
Alpharetta, GA (ONSITE)
About the Role
We are looking for a Java AI / Agent Engineer to help build an AI-powered tool designed for enterprise clients. This role sits at the intersection of strong backend Java engineering and applied AI, with a primary focus on designing and developing intelligent agents using Java and Spring-based technologies.
The ideal candidate is a strong Java developer who has hands-on experience building AI agents, LLM-powered applications, or agentic workflows. You will work directly in Java code to develop agents that can reason, use tools, retrieve information, handle failures, and complete complex workflows.
This is a hands-on engineering role for someone who enjoys experimenting with emerging AI technologies while still following strong software engineering practices.
What You'll Do
· Design, build, and deploy AI agents and agentic workflows using Java and Spring Boot.
· Develop production-quality APIs and backend services using Java 21+ and Spring Boot 3.x.
· Implement agent capabilities including:
o Tool/function calling
o Memory and context management
o Planning and orchestration
o Retries and failure handling
o Guardrails and validation
o Multi-step workflows
· Use Spring AI or LangChain4j to integrate LLMs and orchestrate agent workflows within Spring applications.
· Design effective LLM prompts using templates, roles, constraints, and structured outputs.
· Build and maintain LLM evaluations (evals) to measure agent quality, reliability, and performance.
· Implement LLM observability and monitoring, including tracing, latency, token usage, cost, and failure analysis.
· Apply RAG (Retrieval-Augmented Generation) techniques, including chunking, embeddings, vector databases, and retrieval optimization.
· Use AI coding tools such as GitHub Copilot or Amazon Q as part of the daily software development workflow.
· Collaborate with engineers and stakeholders to prototype, test, and continuously improve AI capabilities.
· Write clean, maintainable, well-tested Java code while incorporating AI capabilities into production applications.
Required Qualifications
Java / Backend Engineering
· Strong professional experience with Java, including modern Java versions such as Java 21+.
· Strong experience with Spring Boot 3.x, including Spring Web, Spring Data, and Spring Security.
· Proven ability to build and support production APIs and backend services.
· Strong understanding of software engineering fundamentals, testing, debugging, and API design.
AI / Agent Development
· Hands-on experience building AI agents or agentic applications.
· Experience with Spring AI, LangChain4j, or a comparable agent/LLM orchestration framework.
· Understanding of agent architecture, including:
o Tool calling
o Memory
o Planning
o Orchestration
o Retries
o Guardrails
· Hands-on experience with LLM prompt design and prompt engineering.
· Experience designing or developing LLM evaluations (evals).
· Understanding of RAG fundamentals, including embeddings, chunking, vector databases, and retrieval tuning.
· Experience with at least one LLM observability/monitoring platform, such as Langfuse, Arize, Weights & Biases, or Datadog.
AI-Assisted Development
· Daily hands-on experience using AI coding assistants, such as GitHub Copilot or Amazon Q.
· Comfortable incorporating AI into development, testing, debugging, refactoring, and code-generation workflows.
Preferred Qualifications
· Experience optimizing LLM applications for performance and cost, including caching, batching, model routing, and prompt/token optimization.
· Experience evaluating and selecting AI models based on quality, latency, cost, and risk.
· Experience deploying AI services to AWS, Azure, or Google Cloud Platform.
· Experience with CLI-based coding assistants such as GitHub Copilot CLI or Claude Code.
· Experience with spec-to-code development, AI-generated testing, or automated refactoring.
· Experience with MCP (Model Context Protocol) or OpenAPI-based tool schemas.
· Experience integrating AI agents with enterprise APIs, databases, and external tools.
What We're Looking For
The strongest candidates will be software engineers first and AI practitioners second—people who can write strong Java code and also understand how to turn LLM capabilities into reliable, production-ready agents.
You don't need to be a machine learning researcher. We are looking for someone who is hands-on with agent development, LLM application architecture, and AI-assisted software development and can translate those capabilities into a Java/Spring production environment.
Key priorities:
Strong Java/Spring engineering
Hands-on AI agent development
Practical LLM/AI application experience
Experience using AI tools to accelerate software development
Ability to build reliable, observable, and production-ready AI solutions
Never miss an opportunity! Create an alert based on the job you applied for.
