All open jobs
EXL

Senior Software Engineer - AI Gateway & Agentic AI Solutions

India · full-time
via Adzuna

First seen Oct 17 · seen live today · via Adzuna

Skills mentioned

c#azure

The posting, as published

Description Top 5 Responsibilities Architect and implement the AI Gateway. Design and build an Azure-native LLM gateway in C# providing unified ingress across multiple model providers (Azure OpenAI, Azure AI Foundry models, and others) - covering intelligent routing, fallback/load balancing, rate limiting and token-quota enforcement, semantic caching, and centralized API key/secret management. Reference the LiteLLM feature set as the functional bar to hit. Build the observability and governance…

Similar open roles