Senior Generative AI Engineer - LLM, RAG & Python

Hybrid in Raleigh, NC, US • Posted 11 hours ago • Updated 11 hours ago
Full Time
On-site
USD 70.00 per hour
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Preventive Maintenance
  • Project Management
  • Performance Management
  • Amazon Web Services
  • Google Cloud
  • Google Cloud Platform
  • LangChain
  • Semantics
  • Optimization
  • Data Modeling
  • MongoDB
  • Cosmos-Db
  • Amazon DynamoDB
  • Security Controls
  • RBAC
  • API
  • Testing
  • Node.js
  • Agile
  • Scrum
  • Kanban
  • SAFE
  • Microsoft Azure
  • Machine Learning (ML)
  • Databricks
  • Evaluation
  • Training
  • Microsoft
  • Generative Artificial Intelligence (AI)
  • Large Language Models (LLMs)
  • Python
  • Cloud Computing
  • Data Engineering
  • Regulatory Compliance
  • Workflow
  • Adapter
  • SQL
  • Database
  • Management
  • Meta-data Management
  • NoSQL
  • Vector Databases
  • Performance Tuning
  • Access Control
  • Encryption
  • Privacy
  • Microservices
  • Continuous Integration
  • Continuous Delivery
  • Artificial Intelligence
  • Documentation
  • Auditing
  • Industrial Relations
  • Law
  • LOS
  • Recruiting
  • Immigration

Summary

Date Posted: 11/19/2026

Hiring Organization: Rose International

Position Number: 511071

Industry: Government/Staffing

Job Title: Senior Generative AI Engineer - LLM, RAG & Python

Job Location: Raleigh, NC, USA, 27607

Work Model: Hybrid

Work Model Details: Onsite 2 days a week

Shift: 8 AM to 5 PM EST, Monday through Friday

Employment Type: Temporary

FT/PT: Full-Time

Estimated Duration (In months): 13

Min Hourly Rate($): 70.00

Max Hourly Rate($): 80.00

Must Have Skills/Attributes: AWS, Azure, Cloud, Google Cloud Platform, Generative AI/GenAI, LLM (Large Language Model), Machine Learning, MongoDB, NoSQL, Python, RAG (Retrieval-Augmented Generation)

Experience Desired:
Hands-on experience in applied machine learning or Generative AI development (3 yrs),
Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph) (3 yrs),
Experience building RAG pipelines or LLM-driven applications (2 yrs),
Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval (2 yrs),
SQL experience including data modeling, transformations, and performance tuning (5 yrs),
Experience implementing AI security controls such as encryption, RBAC, API security, and secret management (2 yrs),
Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions (5 yrs)

Preferred Certifications/Licenses: Azure AI-102, AWS ML Specialty, Google Cloud Platform ML Engineer, SC-100, or Responsible AI coursework

Job Description
Preferred Certifications:
Certifications such as Azure AI-102, AWS ML Specialty, Google Cloud Platform ML Engineer, SC-100, or Responsible AI coursework

Required Skills:
Hands-on experience in applied machine learning or Generative AI development (3 Years)
Experience working with a major cloud platform (Azure, AWS, or Google Cloud Platform) (3 Years)
Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph) (3 Years)
Experience building RAG pipelines or LLM-driven applications (2 Years)
Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval optimization (2 Years)
SQL experience including data modeling, transformations, and performance tuning (5 Years)
Experience with NoSQL/document databases (MongoDB, Cosmos DB, DynamoDB) (2 Years)
Experience implementing AI security controls such as encryption, RBAC, API security, and secret management (2 Years)
Experience applying Responsible AI principles including bias testing, hallucination mitigation, and privacy safeguards (2 Years)
Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions (5 Years)
Experience with Agile (Scrum, Kanban, or SAFe) development (3 Years)
Ability to organize, prioritize, and follow complex and/or detailed technical procedures (3 Years)

Preferred Skills:
Experience with Azure AI Search, Azure Machine Learning, Databricks, or HuggingFace (2 Years)
Familiarity with Promptflow, Ragas, or similar automated evaluation tools (2 Years)
Experience designing supervised finetuning workflows or LoRA-based training pipelines (2 Years)
Familiarity with enterprise governance tools such as Microsoft Purview or similar compliance platforms (2 Years)

Our client is seeking a Senior Generative AI Developer to design, develop, and deploy production-grade AI solutions using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), fine-tuning techniques, and secure enterprise data systems. The role requires strong technical skills in Python, cloud-native development, data engineering, and the integration of structured and unstructured databases into AI systems. The developer ensures all AI solutions adhere to organizational standards for security, privacy, compliance, and Responsible AI principles. This position collaborates with engineering, security, data, product, and governance teams to advance scalable, ethical, and secure AI adoption across the organization

Job Duties:
Build and deploy LLM-driven features, prompts, and agent workflows
Customize models using fine-tuning and adapter techniques
Develop RAG pipelines using vector, SQL, and NoSQL databases
Manage secure ingestion of enterprise content with proper metadata and PII protection
Use relational, NoSQL, and vector databases to support AI workloads
Apply performance tuning, access control, encryption, and compliant data handling
Implement AI safety controls and secure model access
Ensure Responsible AI practices include bias, fairness, and privacy reviews
Build secure, scalable microservices to integrate AI features into applications
Implement best practices for reliability, error handling, and observability
Maintain CI/CD pipelines for models and AI services
Monitor performance, cost, and drift
Support documentation and audit readiness

Additional Details:
An in-person interview is required

Benefits:
For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.


California Pay Equity:
For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.


Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.

Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: roseint
  • Position Id: 511071
  • Posted 11 hours ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.