Choosing small hardware for a local coding AI server
The goal is to run a for narrow coding help without relying on an online AI service. The target task is structured , such as creating a C++11 class with add, delete, and get functions while blocking copy and move constructors. OpenRouter’s free poolside/laguna-xs-2.1 model produced acceptable results for this kind of request.
The missing piece is the model size, because that makes it hard to know how much VRAM similar local hardware would need. The current machine is a gaming PC with a 16GB 6800XT and 32GB , but the case is too large. A Mac mini or a similar small computer is being considered, with the purchase happening in the UK.
Because of work restrictions, AI would only be used for limited tasks like this, but it already looks useful for speeding up repetitive coding chores.
Key points
- The intended use is local coding help from a .
- The example task is generating a C++11 class with specific functions and constructor limits.
- OpenRouter’s poolside/laguna-xs-2.1 free model gave acceptable results, but its size is unclear.
- The current PC has a 16GB 6800XT and 32GB .
- A Mac mini or another compact machine is being considered for a smaller setup in the UK.