AISIX

AISIX is an open-source AI gateway built in Rust that provides a single OpenAI-compatible API in front of multiple LLM providers including OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, and others. It's designed for platform teams and developers who need to manage AI traffic, enforce organization-wide limits and budgets, centralize API keys, and implement guardrails before shipping AI features to production.

The gateway handles routing, rate limiting, caching, failover, and observability with sub-millisecond overhead, running as a single static binary in your infrastructure. It supports streaming, embeddings, audio, and image endpoints, plus virtual routing models that fan out across providers and regions. Teams can switch between models without rewriting code, and the project describes itself as built by the original creators of Apache APISIX.