Lead LLM Chatbot Engineer

About GSPANN
Headquartered in Milpitas, California (U.S.A.), GSPANN provides consulting and IT services to global clients, ranging from mid-size to Fortune 500 companies. With our experience in retail, high-technology, and manufacturing, we help our clients to transform and deliver business value by optimizing their IT capabilities, practices, and operations. Counting on our ten offices, including four global delivery centers, and approximately 1400 employees globally, we offer the intimacy of a boutique consultancy with capabilities of a large IT services firm.

Lead GenAI LLM Chatbot Engineer/Architect
Location-Fremont, CA / Remote
Job Type-Long Term

Key Responsibilities
Lead the development and deployment efforts of LLM-based enterprise applications, such as chatbots on company data.
Contribute to product roadmap and vision.
Implement and evaluate various LLM application logic ( flows ) and prompting strategies and stay up to date with the latest advancements in this field.
Collaborate with other data scientists, software engineers, and product managers to deliver high-quality solutions.
Interact with business stakeholders to gather feedback and tailor solutions to business needs.
Skills Requirements
12+ years of experience in software engineering, machine learning, data science, or artificial intelligence.
Technical leadership and ownership of the software development life cycle.
Expertise developing (e.g. using Flask or FastAPI), deploying, and maintaining APIS.
Strong proficiency in Python and JavaScript/TypeScript.
Significant experience with LLM orchestration tools such as LangChain, Semantic Kernel, or Llama Index.
Strong adherence to software best practices in team settings, including version control (Git), CI/CD, documentation, & unit testing.
Experience using common NLP and/or ML Python frameworks, such as PyTorch, TensorFlow, Transformers/Hugging Face, and NumPy.
Hands-on experience with LLM skills including prompt engineering, fine-tuning, LLMOps, function-calling, and retrieval augmented generation (RAG).
Exposure to Microsoft Azure or similar cloud computing ecosystem.
Experience with DevOps/MLOps/LLMOps.
Excellent written and verbal communication and presentation skills.
Ability to work independently and in a team to work productively with business stakeholders.

Working at GSPANN GSPANN is a diverse, prosperous, and rewarding place to work. We provide competitive benefits, educational assistance, and career growth opportunities to our employees. Every employee is valued for their talent and contribution. Working with us will give you an opportunity to work globally with some of the best brands in the industry. The company does and will take an affirmative action to employ and advance in the employment of individuals with disabilities and protected veterans, and to treat qualified individuals without discrimination based on their physical or mental disability status. GSPANN is an equal opportunity employer for minorities/females/veterans/disability.