Senior AI Software Engineer – Agentic AI / Python
Job at a Glance
Title: Senior AI Software Engineer – Agentic AI / Python
Location: Orlando, FL (onsite 4 days per week)
Contract: W2 only, 12 month contract with potential for extension or conversion to full time with either the client or CEI
Pay: $75-$80/hour + optional medical, dental, vision, 401(k) match
Overview
We are seeking a Senior AI Software Engineer to help advance and productionize a sophisticated agentic AI platform. This role will focus on taking an existing, highly functional AI agent prototype and evolving it into a scalable, observable, and production-ready solution. You will work in a highly iterative environment where experimentation, rapid feedback, and continuous improvement are expected.
Key Responsibilities
- Design, build, and enhance production-grade Python services supporting agentic AI applications.
- Develop and refine multi-agent LLM workflows using frameworks such as Google ADK, LangGraph, A2A, or comparable technologies.
- Implement agent orchestration, tool use, guardrails, structured outputs, and workflow logic.
- Help transition advanced AI prototypes into scalable, reliable production services.
- Establish and improve logging, monitoring, tracing, observability, and operational visibility for AI agents.
- Develop evaluation strategies for LLM and agent performance, including quality, safety, accuracy, and behavioral metrics.
- Support A/B testing and experimentation to continuously improve agent performance.
- Build and maintain integrations with services and APIs consumed by AI agents.
- Work extensively with GCP and Vertex AI for AI services, model serving, retrieval, search, and related platform capabilities.
- Apply prompt engineering techniques to improve agent behavior and response quality.
- Design reliable structured outputs and schemas using tools such as Pydantic.
- Containerize services and support automated build, test, deployment, and CI/CD processes.
- Collaborate with product and engineering teams in a fast-moving Agile environment.
- Troubleshoot production issues across AI agents, backend services, integrations, and supporting infrastructure.
- Continuously iterate on architectures, prompts, tools, and workflows as the platform evolves.
Required Skills
- Strong professional experience developing production-grade Python applications and backend services.
- Advanced knowledge of asynchronous Python, including async/await, concurrency, and asynchronous service architectures.
- Hands-on experience with FastAPI, ASGI, or comparable Python API frameworks.
- Proven experience developing agentic or multi-agent LLM applications.
- Experience with Google ADK, LangGraph, A2A, or similar agent orchestration frameworks.
- Strong understanding of agent tool use, orchestration, workflows, guardrails, and state management.
- Hands-on experience with LLMOps, AI evaluation, or agent evaluation.
- Experience with tools or platforms such as Phoenix/Arize, Vertex AI Evaluation, OpenTelemetry, or comparable observability and evaluation technologies.
- Strong experience with Google Cloud Platform and Vertex AI.
- Experience building production services with containers and modern CI/CD practices.
- Experience with observability, logging, monitoring, and tracing within distributed production systems.
- Strong prompt engineering skills and experience refining LLM behavior through experimentation and evaluation.
- Experience designing structured LLM outputs and schemas using Pydantic or similar technologies.
- Strong software engineering fundamentals and the ability to work effectively in a rapidly evolving, highly iterative environment.
Required Education
- Bachelor’s degree in Computer Science, Software Engineering, Information Technology, Engineering, or a related technical field required.
Preferred Skills
- Experience with Retrieval-Augmented Generation (RAG), embeddings, and vector search.
- Experience supporting large-scale MySQL or other relational database environments.
- Knowledge of enterprise authentication and authorization, including OAuth2 and scopes.
- Experience with MLOps platforms, experimentation, and model or prompt tracking.
- Experience mentoring engineers or contributing to architecture and technical direction.
- Java development experience, particularly Java Reactor / reactive programming.
- Experience integrating AI applications with Java-based or reactive backend services.
- Experience taking Generative AI or agentic AI solutions from prototype through production.
Why Should I Apply?
This role offers the opportunity to productionize an advanced agentic AI prototype into a scalable, observable platform while working in a highly iterative engineering environment.
About CEI:
As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers'' workforce and project requirements.
#ZR #INDGEN
Never miss an opportunity! Create an alert based on the job you applied for.
