Location: Charlotte, NC
Salary: $69.00 USD Hourly - $74.00 USD Hourly
Description: Job TitleSenior AI Software Engineer (Full Stack, GenAI)LocationCharlotte, NC
About the JobWe are seeking a senior, hands-on AI Software Engineer to design, build, and productionize Generative AI applications end to end. In this role, you will work on complex, large-scale initiatives with broad organizational impact, contributing to the strategy, design, and delivery of secure, reliable, and scalable AI systems.
You will lead the development of agentic workflows, retrieval-augmented generation (RAG) pipelines, and cloud-native services on Google Vertex AI. You will collaborate closely with product, data, security, and platform partners to translate ambiguous requirements into high-quality AI solutions that meet business, compliance, and operational goals.
Responsibilities- Design and develop multi-step, agentic AI workflows using LangGraph and LangChain, including tools, memory, retries, timeouts, and state management.
- Analyze and solve complex, multi-faceted software engineering challenges requiring evaluation of multiple technical, operational, and compliance factors.
- Architect and own end-to-end RAG pipelines, including data ingestion, chunking strategies, embeddings, metadata management, and vector indexing.
- Implement advanced retrieval strategies such as hybrid search (BM25 + dense), multi-vector retrieval, reranking, caching, and query planning.
- Productionize AI services on Google Vertex AI, including Models, Endpoints, Pipelines, Vector Search, Feature Store, and Workbench.
- Build and maintain scalable microservices using Python (FastAPI) or Node.js, and user-facing applications using React or Next.js.
- Establish observability and guardrails, including tracing, logging, telemetry, prompt/version tracking, and input/output filtering.
- Define and automate GenAI evaluation frameworks to measure relevance, faithfulness, hallucination rates, latency, and cost.
- Apply security, privacy, and governance controls, including PII detection and masking, policy enforcement, audit logging, and prompt-injection defenses.
- Collaborate strategically with cross-functional stakeholders to plan, scope, and deliver initiatives with large-scale impact.
- Mentor engineers and establish best practices for testing, orchestration, prompt patterns, and model lifecycle management.
Minimum Qualifications- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- 7+ years of software engineering experience, including experience designing and delivering complex, large-scale systems.
- 3+ years of hands-on experience building and operating applied ML or Generative AI systems in production.
- Strong proficiency in Python and experience building production backends with FastAPI or equivalent frameworks.
- Experience with cloud platforms (Google Cloud Platform preferred) and containerized environments (Docker, Kubernetes).
- Ability to consult on complex initiatives and drive solutions that align with technical, business, and compliance requirements.
Preferred Qualifications- Deep expertise with LangChain and LangGraph, including agents, tools, state graphs, retries, sub-graphs, and observability.
- Strong experience designing and operating RAG systems, including embeddings, hybrid retrieval, reranking, and evaluation.
- Hands-on experience with vector databases such as Pinecone, Weaviate, Milvus, or FAISS.
- Experience with Vertex AI services, including Model Garden, Endpoints, Pipelines, Vector Search, and IAM-based architectures.
- Knowledge of GenAI evaluation frameworks (e.g., RAGAS, G-Eval), A/B testing, and human-in-the-loop review processes.
- Familiarity with security and governance in AI systems, including data privacy, isolation, data residency, and secret management.
- Experience with knowledge graphs, structured or SQL/Graph RAG, or LLM tool/function calling.
- Strong communication skills and a demonstrated ability to turn ambiguous problem statements into shipped, high-impact products.
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact: This job and many more are available through The Judge Group. Please apply with us today! 
Never miss an opportunity! Create an alert based on the job you applied for.
