Command A Plus converted into GGUF files for local use
llama.cpp added support for Command A Plus and North Mini Code over the weekend. North Mini Code already had GGUF files available from Unsloth. Up-to-date GGUF files for Command A Plus were hard to find, so the model was converted and quantized.
GGUF is a file format used to run more easily on local computers or servers. makes a model smaller, which can lower memory needs and running cost.
Key points
- llama.cpp now supports Command A Plus and North Mini Code.
- North Mini Code GGUF files were already available from Unsloth.
- Command A Plus was converted because current GGUF files were hard to find.
- can reduce memory use and running cost.
- can help lower the cost of repeated AI .