GenAI Developer ? LLMs, RAG & Knowledge Graphs (Neo4j)

Company Overview

Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milestone culture is built to provide a collaborative, inclusive environment that supports employees and empowers them to reach their full potential.

Our seasoned professionals deliver services based on Milestone's best practices and service delivery framework. By leveraging our vast knowledge base to execute initiatives, we deliver both short-term and long-term value to our clients and apply continuous service improvement to deliver transformational benefits to IT. With Intelligent Automation, Milestone helps businesses further accelerate their IT transformation. The result is a sharper focus on business objectives and a dramatic improvement in employee productivity. Through our key technology partnerships and our people-first approach, Milestone continues to deliver industry-leading innovation to our clients. With more than 3,000 employees serving over 200 companies worldwide, we are following our mission of revolutionizing the way IT is deployed.

Job Overview

GenAI Developer - LLMs, RAG & Knowledge Graphs (Neo4j)

Experience: 5-8 years total (2+ years in Generative AI)
Location: Kochi
Job Type: Full-time

Role Overview

We're looking for a hands-on GenAI Developer to design, build, and productionize LLM-powered applications-retrieval-augmented generation (RAG), conversational agents, document understanding, and decision support. You'll combine AWS Bedrock/SageMaker with open-source stacks and integrate a Neo4j knowledge graph to deliver reliable, explainable AI in a product environment.

What You'll Do

• Ship end-to-end GenAI features: data ingestion chunking/embedding RAG pipelines prompt orchestration evals deployment monitoring.
• Build robust RAG systems: hybrid retrieval (vector + keyword), query re-writing, reranking, citations, and grounding on enterprise data.
• Model orchestration on AWS: Bedrock model selection (Claude, Llama, etc.), prompt flows, guardrails, and cost/perf tuning; SageMaker for custom training/fine-tuning (LoRA/QLoRA/PEFT).
• Knowledge Graph (Neo4j): design schema/ontologies, build entity/relation extractors, create KG-augmented RAG, and run graph reasoning with Cypher & GDS.
• Eval & quality: define automatic evals (faithfulness, answer relevance, toxicity, latency), A/B tests, and red-teaming; maintain prompt and dataset versioning.
• Ops & reliability: implement LLMOps (observability, tracing, guardrails, rate/cost controls), CI/CD, IaC, and runtime monitoring.
• APIs & apps: expose services via REST/GraphQL; build lightweight UIs or chat backends, integrate auth, and log interactions for continuous improvement.
• Security & compliance: PII handling, prompt injection defense, output filtering, and enterprise IAM hygiene.

Core Skills & Tech Stack

Languages & Frameworks

• Python (FastAPI), TypeScript/Node.js (nice-to-have), SQL
• GenAI frameworks: LangChain / LlamaIndex / Haystack
• Prompt tooling & observability: Langfuse, Weights & Biases (or equivalents)

LLMs & Modeling

• Retrieval & embeddings: Bedrock embeddings, sentence-transformers, Cohere/HF embeddings
• Fine-tuning/distillation: LoRA/QLoRA/PEFT, bitsandbytes, Hugging Face ecosystem
• Rerankers & rewriters: cross-encoders, T5/FLAN or similar
• Safety/guardrails: content filters, groundedness checks, regex/policy engines

AWS (Focus)

• Bedrock (model access, guardrails), SageMaker (training, endpoints), ECR/ECS/EKS, Lambda, API Gateway, S3, CloudWatch, Step Functions
• OpenSearch / Kendra for retrieval; RDS/ Aurora / DynamoDB for metadata/state
• IAM, Secrets Manager, VPC for security & networking

Knowledge Graphs

• Neo4j (schema/ontology design, Cypher, APOC), Graph Data Science (GDS)
• Entity/relation extraction pipelines; KG-RAG patterns; graph-based reasoning and path explanations

Vector/Search

• OpenSearch vector, pgvector, Milvus, or Pinecone (any 1-2 strongly)

MLOps / LLMOps

• MLflow or SageMaker Model Registry; Docker; CI/CD (GitHub Actions/GitLab)
• Tracing/telemetry, dataset & prompt versioning, cost/latency dashboards

Qualifications

• Bachelor's/Master's in CS/EE/Math or equivalent practical experience
• 5-8 years building data/ML systems; 2+ years specifically with LLMs/GenAI
• Proven production deployments on AWS and experience with Neo4j in real use cases

Compensation

Estimated Pay Range:

Exact compensation and offers of employment are dependent on circumstances of each case and will be determined based on job-related knowledge, skills, experience, licenses or certifications, and location.

Our Commitment to Diversity & Inclusion

At Milestone we strive to create a workplace that reflects the communities we serve and work with, where we all feel empowered to bring our full, authentic selves to work. We know creating a diverse and inclusive culture that champions equity and belonging is not only the right thing to do for our employees but is also critical to our continued success.

Milestone Technologies provides equal employment opportunity for all applicants and employees. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, gender, gender identity, marital status, age, disability, veteran status, sexual orientation, national origin, or any other category protected by applicable federal and state law, or local ordinance. Milestone also makes reasonable accommodations for disabled applicants and employees.

We welcome the unique background, culture, experiences, knowledge, innovation, self-expression and perspectives you can bring to our global community. Our recruitment team is looking forward to meeting you.