Local proxy tool tracks LLM call costs and billing accuracy

Local proxy tool tracks LLM call costs and billing accuracy

Inferock-bench is a that sits between your app and —OpenAI, Anthropic, Gemini, and pinned versions of . It intercepts each call to log and failures, and produces receipts that let you verify whether the billing you're charged matches what was actually used. It rather than requiring a .

Key points

  • Supports OpenAI, Anthropic, Gemini, and pinned calls
  • Runs as a , no needed
  • Logs and call failures
  • Produces billing-integrity receipts to verify charges match usage
Read original