Otari

Otari is an open-source gateway that sits between applications and language model providers, routing requests to 40+ LLM services through a single endpoint. It handles authentication, manages provider credentials securely, enforces budget limits before spending, and tracks usage across requests. The project describes itself as an alternative to managing multiple provider integrations directly.

Designed for developers and teams wanting control over their AI stack, Otari offers virtual API keys with granular scoping, local routing policies for failover and load balancing, and optional features like code execution, web search, and inference guardrails. It runs standalone with your own database or connects to a managed data plane, and is compatible with OpenAI and Anthropic clients.