AI Gateway Engineer

Milpitas, CA, US • Posted 2 hours ago • Updated 2 hours ago
Contract W2
6 Months
Occasional Travel Required
On-site
$50 - $55/hr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • GenAI
  • IAM
  • IDENTITY ACCESS MANAGEMENT
  • AI
  • ARTIFICAL INTELLIGENCE

Summary

Key Responsibilities

AI Gateway Platform Engineering

  • Design and implement enterprise AI Gateway platforms for GenAI, Agentic AI, and LLM workloads.
  • Build and manage centralized ingress and egress gateways for AI applications, agents, MCP servers, and external AI services.
  • Develop AI traffic routing, model orchestration, load balancing, failover, and request governance capabilities.
  • Implement model abstraction layers supporting multiple AI providers including OpenAI, Azure OpenAI, Anthropic, Google Gemini, AWS Bedrock, and private models.
  • Design multi-tenant AI platform architectures for enterprise consumption.
  • Establish AI service onboarding standards and platform governance processes.

Experience

  • 7+ years in Platform Engineering, Cloud Engineering, Security Engineering, or IAM.
  • 3+ years in AI/GenAI platform implementation.
  • Experience deploying enterprise AI solutions in production environments.
  • Strong exposure to secure software development and cloud-native architectures.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10179237
  • Position Id: 9144680
  • Posted 2 hours ago
Contact the job poster
HJ

Harish Joshi

Recruiter @ Resource Logistics

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.