Gen AI Lead

Job Description – Gen AI Lead

Position: Gen AI Lead
Experience: 10+ Years
Location: New York City, NY / Charlotte, NC (Hybrid)

Job Summary

We are seeking an experienced Gen AI Lead to drive the design, development, and delivery of enterprise-scale Generative AI solutions. The ideal candidate will have deep expertise in Large Language Models (LLMs), AI application architecture, RAG frameworks, and cloud technologies, along with proven leadership experience in managing technical teams and delivering AI initiatives in the banking or financial services domain.

Required Skills

• 10+ years of experience in Software Engineering, AI/ML, or Data Engineering.
• 3+ years of hands-on experience with Generative AI and Large Language Models (LLMs).
• Strong expertise with OpenAI, Azure OpenAI, Anthropic Claude, Gemini, or Llama models.
• Hands-on experience with LangChain, LangGraph, LlamaIndex, Semantic Kernel, or similar orchestration frameworks.
• Experience building Retrieval-Augmented Generation (RAG) solutions using vector databases such as Pinecone, ChromaDB, FAISS, Weaviate, or Milvus.
• Strong programming skills in Python.
• Experience developing APIs using FastAPI or Flask.
• Expertise with cloud platforms (AWS, Azure, or Google Cloud Platform) and container technologies (Docker, Kubernetes).
• Experience implementing CI/CD pipelines, Git, and DevOps best practices.
• Strong understanding of AI governance, security, prompt engineering, and model evaluation.
• Banking or Financial Services experience is highly preferred.

Responsibilities

• Lead the architecture and development of enterprise Generative AI platforms and applications.
• Define technical strategy, AI roadmap, and best practices for Gen AI implementations.
• Design scalable RAG pipelines and intelligent AI assistants.
• Mentor and guide engineering teams on Gen AI technologies and solution architecture.
• Collaborate with business stakeholders to identify AI use cases and translate them into technical solutions.
• Optimize LLM performance, prompt engineering, and inference costs.
• Integrate AI solutions with enterprise applications and banking platforms.
• Ensure compliance with enterprise security, governance, and responsible AI standards.
• Drive production deployment, monitoring, and continuous improvement of AI applications.

Preferred Qualifications

• Experience leading enterprise AI transformation initiatives.
• Knowledge of AI agents, multi-agent frameworks, and workflow automation.
• Experience with MLOps/LLMOps tools and AI observability.
• Familiarity with distributed systems and microservices architecture.
• Excellent communication, stakeholder management, and leadership skills.