A 64GB Mac mini used for local LLM character experiments
A 64GB Mac mini is being used as a machine for personal . The goal is to make fictional characters from prose feel alive in conversation. The setup builds on prior experience with BERT and GPT-style models at work, plus earlier local model experiments on a MacBook using models larger than 8B parameters.
Those earlier tests mostly used RAG for question answering and PDF summarization. The current plan already includes detailed character notes for persona prompting and world-building notes for RAG. The next step is to move beyond those basics and find better ways to control a character’s behavior and personality.
Possible resources include datasets, models, libraries, common setup patterns, and research on understanding or steering model behavior. About $750 per year in LLM could also be used to create custom .
Key points
- A 64GB Mac mini is being used for .
- The goal is to make fictional characters behave and speak more consistently.
- Persona prompting and RAG are already part of the plan, but may not be enough.
- About $750 per year in LLM could help create custom .
- This points to the Mac mini as a practical home machine for private AI experiments.