Philadelphia, Pennsylvania
•
3d ago
Consultant Requirements On-Prem LLM & Vector DB Implementation Core Experience Hands-on experience deployingopen-source LLMssuch asMeta Llama 3andMistral / Mixtralin on-prem or private environments Strong proficiency inPythonfor LLM inference, prompt engineering, and integration Experience withCPU-based inference, model quantization, and performance tuning Vector Databases & RAG Practical experience withopen-source vector databasessuch asQdrant,Chroma,Milvus, orpgvector Proven impleme
Easy Apply
Third Party, Contract
Depends on Experience


















