Key Responsibilities
Design, build, deploy, and operate AI Gateway solutions across Azure and AWS, taking solutions from proof of concept through production.
Develop and enhance Python services using FastAPI and Flask for inference, onboarding, and administrative APIs.
Integrate new model providers and model families, including Azure AI Foundry, Azure OpenAI, and AWS Bedrock.
Implement request signing, streaming responses, failover, and quota-handling capabilities.
Implement secure cloud-native authentication and secrets management using Entra ID, Managed Identity, workload federation, AWS IAM roles, and STS.
Build and maintain entitlement and authorization data layers using SQL Server and PostgreSQL, including schema changes, migrations, and data-quality controls.
Develop platform governance capabilities, including rate limiting, token accounting, content guardrails, audit logging, and chargeback reporting.
Deploy and operate services across Kubernetes environments, including on-premises, AKS, and EKS, using Helm, GitOps, and Terraform.
Maintain and enhance CI/CD pipelines using Jenkins and GitHub Actions.
Build comprehensive monitoring and observability capabilities using Prometheus, Grafana, Loki, and Snowflake.
Partner with cloud, network, and security teams on connectivity, egress policies, network controls, architecture reviews, and supporting documentation.
Participate in on-call production support, investigate incidents, and implement fixes and platform hardening improvements.
Develop tests and technical documentation as part of the delivery process.
Review peer code and contribute to overall engineering quality and best practices.
Required Qualifications
5+ years of experience
Bachelor's Degree
Skills
Python Development
Kubernetes
Microsoft Azure
AWS
Infrastructure as Code
CI/CD
SQL
OIDC
OAuth 2.0
Observability
Kafka
Snowflake
PromQL
OpenTelemetry
Redis
Valkey
AI/ML Technologies
Software Testing Practices
Relational Data Modeling
Written and Verbal Communication
Cross-functional Collaboration
API Gateway Management
LLM Platform Engineering Concepts
Regulated Enterprise Environment Experience
Schedule
Start date: 2026-10-12
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: compun
- Position Id: KUMDC5939094
- Posted 11 hours ago
Never miss an opportunity! Create an alert based on the job you applied for.
