Senior AI/ML Program Manager

Responsibilities:
Lead AI/ML program execution, ensuring timely delivery of scalable, production-grade RAG/LLM/Agentic solutions.
Define program roadmaps through PI planning sessions, milestones, and deliverables for AI-driven initiatives across multiple teams.
Manage LLM infrastructure, GPU optimization, AI inferencing pipelines, and large-scale model deployment strategies.
Oversee the implementation of RAG, Agentic Workflows, multi-agent LLM systems, and Retrieval-augmented QA pipelines.
Managing client engagement and delivery per terms of the contract expectations.
Manage project delivery, team and ensure positive customer relations.
Drive project margins optimization using Gen AI based tools, accelerators.
Collaborate with our diverse and global teams to deliver committed results to our clients.
Lead AI-driven engagements, ensuring alignment with business goals, technical feasibility, and governance frameworks.
Develop and execute strategic roadmaps for LLM-based solutions, including RAG (Retrieval-Augmented Generation), Agentic RAG, and Agent-driven workflows.
Manage cross-functional teams, including ML engineers, data scientists, software developers, and consultants to deliver AI solutions.
Collaborate with stakeholders to define technical architecture, infrastructure requirements, and optimization techniques.
Implement scalable AI agent architectures, ensuring integration with LangChain, NVIDIA NeMo, and Triton Inference Server.
Track project performance, set KPIs, and provide executive-level reporting on outcomes and ROI.
Guide AI model evaluation, MLOps pipeline integration, and fine-tuning strategies for scalable AI solutions.
Travel to client location as needed.
Support AI compliance strategies, ensuring alignment with data privacy, security, and responsible AI practices.

Skill Set Required:
7 plus years of Program Management experience.
Strong leadership and multi-stakeholder management skills.
Multi-Workstream Project Management ensuring customer success & account growth.
Maintaining positive work environment & ensure career growth of the team members.
Tight Delivery execution and reporting to senior management at client organization and at Quantiphi.
Mentoring team members for career progression & upskilling to drive better solution outcomes.
Team leading experience and ability & experience to work as project lead.
Excellent Communication, presentation & storytelling skills.
Must have experience with Cloud Google Cloud Platform or AWS or Azure (LLM hosting, GPU-based inference, cost optimization).
Experience managing large-scale AI projects leveraging LLMs (e.g., Llama, GPT, Claude, Mistral).
Strong expertise in RAG, Agentic RAG, AI Agents, Vector DBs (e.g., FAISS, Pinecone, Weaviate, ChromaDB).
Knowledge of LLM-based fine-tuning techniques, Low-Rank Adaptation (LoRA), Quantization (AWQ, GPTQ, FP8, INT4).
Familiarity with multi-GPU parallelization, model pruning, and knowledge distillation.
Understanding of Governance frameworks (e.g., AI Ethics, Explainability, Risk Mitigation).
Proficiency in NVIDIA NeMo, Triton Inference Server, and LangChain for Agentic workflows.
Bachelor's degree in CompSci, Business IT, or other related fields or equivalent work experience. MBA is highly desirable