Overview
Remote
Depends on Experience
Contract - W2
Contract - 6 Week(s)
Skills
Azure API Mgmt
Azure API
Azure
Entra ID
LLM
API
Log
APIM
Job Details
Responsibilities:
Scope 1:
- Configure diagnostic settings in APIM to stream logs to Log Analytics Workspace (LAW).
- Enable centralized monitoring and visibility through the APIM console.
- Establish API connections and backend pools to support regional load balancing across multiple APIM instances.
Expected Outcomes:
- Improved observability and traceability across all API interactions.
- Early detection and resolution of performance or availability issues.
- Foundational setup for regional scalability and traffic optimization.
Scope 2:
- Implement endpoint-level token quotas to manage and control API consumption.
- Enable semantic caching in APIM to reduce repetitive LLM requests and improve latency.
Expected Outcomes:
- Controlled token utilization, minimizing risk of service throttling or overuse.
- Enhanced performance and response times through intelligent caching.
- Optimized cost efficiency by reducing redundant LLM calls.
Scope 3:
- Configure private endpoints within VNet/Subnet to ensure secure, internal-only communication between APIM and backend APIs.
- Integrate Microsoft Entra ID to enforce token-based access restrictions, apply usage quotas, and strengthen governance.
Expected Outcomes:
- Enhanced security posture by eliminating public exposure of internal endpoints.
- Centralized identity-based access control and improved compliance alignment.
- Strengthened governance and auditability across all API traffic.
Required Skills
- Prior hands-on experience and expertise implementing Azure API Management as an AI Gateway fronting Open AI.
- Azure API Mgmt
- OpenAI
- Azure
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.