New AI models can cost less per finished task

New may look more expensive if you only compare the price of one input and output. But if they solve the job more reliably, the cost per finished task can be lower.

The useful measure is not one call’s price, but how many tries it takes to get a correct result. A stronger model that succeeds once can be cheaper than a weaker model that needs several .

Key points

  • Compare total cost per finished task, not just price per call.
  • A newer model can be cheaper overall if it needs fewer .
  • can become costly when one failed step causes more failed steps later.
  • Use cheaper for easy work and stronger where mistakes are expensive.
Read original