Java Developer :: Jersey City, Tampa, Newark :: Hybrid

Java Developer Generative AI/LLM Engineer
Locations: Jersey City, Tampa, Newark
Work Model: Hybrid
Contract Long Term

Role Overview

Looking for experienced Java developers with strong exposure to Generative AI technologies, including Large Language Models (LLMs), NLP, and Retrieval-Augmented Generation (RAG). The role involves building enterprise-grade AI-powered applications, scalable backend systems, and cloud-native microservices for financial and enterprise clients.

Key Responsibilities

• Design and develop enterprise applications using Java, Spring Boot, and microservices architecture.
• Build and integrate Generative AI solutions using LLMs such as OpenAI GPT, Gemini, Claude, Llama, or Mistral.
• Develop and optimize RAG pipelines for enterprise knowledge retrieval systems.
• Implement prompt engineering, prompt tuning, and reusable AI workflows.
• Build AI-powered APIs, copilots, chatbots, and automation solutions.
• Integrate vector databases such as Pinecone, PGVector, Mongo Atlas, Neo4j, or similar.
• Work with NLP techniques and unstructured data processing.
• Deploy AI/ML solutions into production environments.
• Collaborate with cross-functional teams in Agile/Scrum environments.
• Ensure secure coding, scalability, performance optimization, and CI/CD best practices.

Required Skills

Core Java Stack

• Java 8/11/17+
• Spring Boot
• REST APIs
• Microservices
• Kafka (preferred)
• Distributed systems

Generative AI / AI Skills

• Hands-on experience with:
  • LLMs
  • RAG architecture
  • NLP
  • Prompt engineering
  • AI agents / agentic frameworks
• Experience with:
  • LangChain
  • LlamaIndex
  • Hugging Face
  • Vertex AI
  • OpenAI APIs

Cloud & DevOps

• AWS / Azure / Google Cloud Platform
• Docker & Kubernetes
• CI/CD pipelines
• Jenkins / GitLab CI / Azure DevOps
• MLOps concepts

Databases & Data

• SQL / NoSQL databases
• Vector databases
• Handling large-scale unstructured data

Preferred Qualifications

• Product company background
• Financial services/domain experience preferred
• Strong architecture and design skills
• Experience leading offshore/onshore teams
• Strong communication and stakeholder management skills