Small AI model runs very fast inside a browser

The LFM2.5 230M AI model ran inside a browser at about 1,400 . The work happened locally on the user’s device, not on a . The speed came from custom .

The recorded demo used an Apple M4 Max machine. The model is LiquidAI/LFM2.5-230M in GGUF format, and a live demo is available on .

Key points

  • LFM2.5 230M ran in a browser at about 1,400 .
  • The model ran locally on the device instead of using a .
  • Custom were used to speed up the run.
  • The demo was recorded on an Apple M4 Max machine.
  • This points to lower-cost agent designs that use small for simple steps.
Read original