AI Architect ; Production GenAI/LLM architecture (RAG, agents)

Hybrid in Charlotte, NC, US • Posted 3 hours ago • Updated 3 hours ago
Full Time
No Travel Required
Hybrid
$140,000 - $160,000/yr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • LLMs and GenAI: prompt engineering
  • RAG
  • embeddings
  • and agent frameworks (e.g.
  • LangChain
  • LlamaIndex)
  • Strong Python skills and fluency in ML frameworks (PyTorch
  • TensorFlow
  • scikit-learn) Deep experience with at least one major cloud (AWS
  • Azure
  • or GCP) and its AI services (e.g.
  • SageMaker
  • Bedrock
  • Azure OpenAI
  • Vertex AI)

Summary

Job Title: AI Architect (GenAI / MLOps)

Position Overview
Turning promising AI ideas into production systems that are secure, compliant, and built to scale is the hard part of enterprise AI. This role sits at the center of that work. You’ll own the architecture for enterprise AI and GenAI solutions end to end, from data foundations and model selection through deployment, governance, and monitoring. You’ll work closely with business, data, engineering, and risk teams, and you’ll advise executives on what’s feasible, what’s worth it, and what the trade-offs are.

What You’ll Do / Key Responsibilities

  • Design end-to-end AI/ML and GenAI architectures (RAG, agents, fine-tuning, model serving) that integrate with existing enterprise platforms
  • Evaluate and select LLMs, vector databases, orchestration frameworks, and MLOps tooling
  • Define reference architectures, patterns, and standards for reuse across teams
  • Partner with data engineering on pipelines, feature stores, and data quality for AI workloads
  • Build in responsible AI: model risk management, explainability, bias testing, audit trails, and regulatory compliance
  • Establish MLOps/LLMOps practices covering CI/CD, evaluation, observability, drift detection, and cost control
  • Lead proofs of concept and pilots, and move them to production
  • Advise stakeholders and executives on AI strategy, feasibility, and trade-offs
  • Mentor engineers and data scientists, and run architecture reviews

Required Qualifications

  • 16+ years in software or data engineering, with 4+ years architecting AI/ML solutions in production
  • Hands-on experience with LLMs and GenAI: prompt engineering, RAG, embeddings, and agent frameworks (e.g., LangChain, LlamaIndex)
  • Strong Python skills and fluency in ML frameworks (PyTorch, TensorFlow, scikit-learn)
  • Deep experience with at least one major cloud (AWS, Azure, or Google Cloud Platform) and its AI services (e.g., SageMaker, Bedrock, Azure OpenAI, Vertex AI)
  • Experience with MLOps tooling (MLflow, Kubeflow, Docker, Kubernetes, CI/CD)
  • Solid grounding in data architecture: data lakes/warehouses, streaming, APIs, and microservices
  • Knowledge of security, privacy, and governance for AI systems
  • Excellent communication, with the ability to explain technical trade-offs to non-technical leaders

Preferred Qualifications

  • Experience in banking, insurance, or asset/wealth management, including regulatory expectations (e.g., SR 11-7 model risk)
  • Experience with vector databases (Pinecone, pgvector, OpenSearch) and fine-tuning or evaluation frameworks
  • Cloud or architecture certifications (e.g., AWS ML Specialty, Azure AI Engineer, TOGAF)
  • Master’s or PhD in Computer Science, Data Science, or a related field
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91173480
  • Position Id: 9120983
  • Posted 3 hours ago

Company Info

About SKANDA SOLUTIONS LLC

In today’s competitive talent market, finding the right candidates for your open positions can be a daunting task. Our team of experienced recruiters is dedicated to finding the right fit for each client and candidate. We take the time to understand your company culture and specific needs, and we use a variety of methods to attract and screen candidates, including online job postings, social media networking, and referrals. We also conduct thorough reference checks to ensure that our candidates are qualified and a good fit for your team.

 

We are committed to providing our clients with the highest level of service. We are responsive, communicative, and results-oriented. We will work closely with you throughout the hiring process to ensure that you find the perfect candidate for your open position. We invest our efforts into forming relationships with employers and job seekers to ensure the best job placements possible. We share your sense of urgency and we are dedicated to your success.

About_Company_OneAbout_Company_Two
Contact the job poster
NK

Ninad Kasala

Recruiter @ SKANDA SOLUTIONS LLC

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.