OmniRoute adds one local gateway for many AI model providers
OmniRoute is a self-hosted gateway that lets agent tools call many AI providers through one address. It uses an format, so existing tools can point to one endpoint such as `localhost:20128/v1` without major rewrites. It says it supports 237 providers, with more than 90 free routes.
Its main feature is automatic fallback: if one provider fails, returns a server error, or hits a rate limit, the request can move to the next model in a prepared ladder. That ladder can start with a , then API keys, then cheaper models, then free options. OmniRoute also adds a compression step for long tool output such as code diffs, test logs, and build logs, aiming to cut token use by 60% to 90%.
It includes 17 routing methods, including priority, weighted, round-robin, and cost-based routing, plus safeguards for failing providers, keys, and models. The project is open source under the MIT license and is meant to run on your own machine or server.
Key points
- OmniRoute puts many AI providers behind one .
- It claims support for 237 providers, including more than 90 free routes.
- Automatic fallback can move a request to another model when a provider fails or rate-limits it.
- The compression step targets long tool output and aims to reduce token use by 60% to 90%.
- It is self-hosted and released under the MIT license.
Sources covering this story (7)
- r/AIAgentsStackOmniRoute adds one local gateway for many AI model providers ↗
- Hacker NewsShow HN: An unmetered LLM API–$6/month, no token tracking, no limits ↗
- r/AIAgentEngineeringProduction agent infra: millisecond provider fallback, 60–90% tool-output compression, and an MCP/A2A control plane (self-hosted, MIT) ↗
- r/AiBuildersI spent ~4.5 months building a free, self-hosted AI gateway: 237 providers (90+ free), auto-fallback, and a token-compression pipeline (MIT) ↗
- r/Agentic_AI_For_DevsA self-hosted OpenAI-compatible gateway for agent dev: 237 providers, millisecond fallback, and a compression pass that cuts tool-output tokens 60–90% ↗
- r/vibecodingitaliabrowser-search — tre strumenti a costo zero, e il tuo agente IA impara a cercare e navigare sul web ↗
- r/u/techsd2015OmniRoute — open-source AI gateway that pools ALL your accounts, routes to 60+ providers, 13 combo strategies, 11 providers at $0 forever. One endpoint for Cursor, Claude Code, Codex, OpenClaw, and every tool. MCP Server (25 tools), A2A Protocol, Never pay for what you don't use, never stop coding. ↗