1-bit Bonsai models fit 8B parameters into about 1GB
The 1-bit Bons with 8 billion is about 1GB and remains functional. A newly released 27-billion- version is also only about 5GB. Models this small could make local AI easier to store and run while reducing memory needs.
However, no results are provided for quality, speed, or required specialized tools, so it is too early to know whether 1-bit models are ready for broad use. Their best practical role also remains an open question.
Key points
- The 1-bit Bons with 8 billion is about 1GB.
- The 27-billion- 1-bit version is about 5GB.
- The smaller 8-billion- model is described as functional.
- There is not enough evidence yet to settle its quality, speed, or main use.