Lead Software Engineer - GenAI

• Design and build reusable GenAI platform components, including:
  • Prompt orchestration layers
  • Secure gateway abstraction using tools like LiteLLM, Portkey, or Kong
  • Embedding and retrieval infrastructure using vector databases like Pinecone, or FAISS
  • Audit, logging, and trace analysis with tools like LangSmith
  • Guardrails integration for output validation, safety checks, and policy enforcement

• Develop multi-turn LLM agents and tools using LangGraph and LangChain to automate operational workflows
• Build robust APIs, SDKs, and accelerator components that serve as initializers for internal product teams, bots, and platforms to rapidly integrate and adopt GenAI services
• Standardize approaches to context management, tool calling, fallback handling, and observability across agents
• Ensure platform components meet security, governance, and compliance standards
• Partner with infrastructure, data, security, and product teams to integrate GenAI workflows into existing systems
• Required Education, Experience/Skills/Training:
• Minimum and Preferred. Inclusive of Licenses/Certs (include functional experience as well as behavioral attributes and/or leadership capabilities)

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 8+ years of backend or platform engineering experience, with a track record of building scalable APIs
• Hands-on experience integrating with LLM APIs such as OpenAI, Claude, and Anthropic, and building LLM-powered workflows, agents, or AI assistants
• Proficient in Python; familiarity with LangChain, LangGraph, or similar LLM orchestration frameworks
• Familiarity with observability practices for LLM-based systems, including logging, latency tracking, and output monitoring
• Experience with LLM evaluation and testing frameworks to validate prompt behavior and agent reliability across iterations
• Strong understanding of cloud-native design patterns, secure AI API integration, and service scalability
• Working knowledge of vector databases such as Pinecone, FAISS, or Weaviate, along with retrieval-augmented generation (RAG) techniques
• Experience building modular, reusable GenAI components that support cross-functional adoption and internal accelerators
• Comfort working with CI/CD pipelines and collaborating with DevOps teams to deploy and monitor GenAI workflows

• Experience with LangSmith, PromptLayer, or tracing tools for debugging and evaluation of LLM workflows.
• Knowledge of AI gateway patterns and usage throttling like Kong, LiteLLM, or Portkey.ai
• Familiarity with guardrails, safety evals, prompt injection defense, and model governance frameworks.
• Previous experience building platforms or enablement tooling used across multiple engineering teams.

• Comprehensive medical benefits
• Competitive pay, 401(k)
• Retirement plan
• and much more!

Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.