PrismML claims a 27-billion-parameter AI model runs on an iPhone

Khosla-backed PrismML says it compressed Alibaba’s open-source enough to run on an iPhone 17 Pro. The model has 27 billion parameters, far more than the few billion usually active at once in phone-based models.

PrismML claims it can handle complex conversations, reasoning, software coding, and tasks directly on the phone. The compressed model is scheduled to become available for download as open source next Tuesday.

Models with trillions of parameters are still much too large for mobile devices. Chief executive Babak Hassibi predicts that within about three years, devices such as phones, laptops, and appliances could handle 95% of the AI work people need, leaving only the hardest 5% for .

Key points

  • PrismML claims a 27-billion-parameter Qwen model runs on an iPhone 17 Pro.
  • The company lists conversation, reasoning, coding, and work among its .
  • The compressed model is due to be released as open source next Tuesday.
  • could reduce paid cloud calls and network delays.
  • Independent tests of quality, speed, memory use, and battery drain are still needed.
Read original