Can a Mac Mini M4 24GB run a local LLM well?
A new with 24GB of memory is being set up with the goal of using a instead of relying on outside AI services. The main concern is whether this hardware will feel too slow or produce weak answers.
The practical question is which model works best on a similar Mac Mini setup. There is also concern that full local use may not be enough, and that a cheaper external Chinese model may still be needed for useful results.
Key points
- The hardware is a with 24GB of memory.
- The goal is to run a after initial setup.
- The main worry is slow speed or low answer quality.
- The open question is which model works best on this kind of Mac Mini.
- A cheaper external model may still be needed if local results are not good enough.