Why AI tool spending can run away even at big companies

Microsoft reportedly used a yearly AI budget in 4 months, raising a basic question about why a large company could not control spending. AI model costs often depend on tokens, the small units a model reads and writes, so heavy use can quickly become expensive.

Large companies such as Microsoft or Uber should be able to track spending by employee, set team budgets, and add before costs run too high. A small CRM company in Paris already had a dashboard showing token use by team, each person’s budget, and a process for asking for more credits after a budget ran out.

Even a can set a spending cap in Claude settings when using the API for projects. If the model is called through Azure, spending caps may be harder to set, but the open question is why the company behind Azure would not have stronger controls in place.

Key points

  • AI model costs can grow quickly because usage is often measured in tokens.
  • Team and employee-level s are possible even at small companies.
  • Solo API projects should use spending caps when the provider supports them.
  • Azure-based model use may make spending controls harder to configure.
  • Large companies can still lose control of AI budgets when usage spreads quickly.
Read original