Software Developer/Engineer - W2 Only - Philadelphia, PA (Hybrid)

Job Title: Software Developer/Engineer Position Type: Contract Location: Philadelphia ,Pennsylvania. Note: Hybrid, minimum 3 days in the office Interview Schedule: 1st interview, 1-hour, in-person; 2nd interview, 1-hour, in-person Consultant Requirements On-Prem LLM & Vector DB Implementation Core Experience Hands-on experience deploying open-source LLMs such as Meta Llama 3 and Mistral / Mixtral in on-prem or private environmentsStrong proficiency in Python for LLM inference, prompt engineering

Consultant Requirements On-Prem LLM & Vector DB Implementation Core Experience Hands-on experience deploying open-source LLMs such as Meta Llama 3 and Mistral / Mixtral in on-prem or private environmentsStrong proficiency in Python for LLM inference, prompt engineering, and integrationExperience with CPU-based inference , model quantization, and performance tuning Vector Databases & RAG Practical experience with open-source vector databases such as Qdrant , Chroma , Milvus , or pgvec

Job Description We are seeking an experienced consultant to lead the design and deployment of a secure, on-premises Large Language Model (LLM) solution integrated with vector database and Retrieval-Augmented Generation (RAG) capabilities. The ideal candidate brings deep hands-on expertise across the full stack from model deployment and inference optimization to enterprise security and knowledge transfer. Core Experience The consultant must have demonstrated experience deploying open-source LLMs

Title: Software Developer/Engineer (Mid Level experience) Location: Philadelphia | Work Mode: Hybrid, minimum 3 days in the office Position Type: Contract Interview Schedule: 1st interview, 1-hour, in-person; 2nd interview, 1-hour, in-person Job Description Consultant Requirements On-Prem LLM & Vector DB Implementation Core Experience Hands-on experience deploying open-source LLMs such as Meta Llama 3 and Mistral / Mixtral in on-prem or private environmentsStrong proficiency in Python for LLM in