Ferro Labs AI Gateway

Ferro Labs AI Gateway is a single Go binary that sits between your application and multiple LLM providers, exposing an OpenAI-compatible API. It routes requests across 30 providers and 2,500+ models while enforcing safety policies, cost controls, and rate limits through built-in plugins. The project describes itself as an alternative to LiteLLM. It includes production observability, request logging, a React dashboard embedded in the binary, and sub-millisecond routing overhead with retries and circuit breakers.

Designed for teams managing multiple LLM integrations, it eliminates the need for client code changes when switching providers or models. The gateway runs as a 32 MB static binary with no external dependencies, deployable via Docker, Homebrew, or direct installation. It supports authentication via scoped API keys and includes comprehensive monitoring with /livez and /readyz probes for orchestrators.