ProviderBench compares LLM hosting providers on speed, price, uptime
ProviderBench is a free website that compares companies hosting (LLMs). Existing leaderboards often compared different model lineups across providers, which could make a provider look faster simply because it served smaller models.
ProviderBench avoids this by only comparing providers that host the exact same model ID. It currently covers 295 verified provider comparisons, tracking response time, time to first response, throughput ( speed), price, uptime, , and exact routing tags.
The site is free with no signup required, and offers pages for comparing providers head-to-head, comparing models across providers, and viewing overall metrics per provider. The developer is especially seeking feedback on how the per-model price/speed winner is calculated.
Key points
- Compares providers only on identical model IDs to avoid misleading comparisons
- Covers 295 verified provider comparisons (response time, throughput, price, uptime, context, etc.)
- Free, no signup required
- Offers provider-vs-provider, model-vs-model, and per-provider overview pages