A local Hermes setup idea for a 128GB Strix Halo PC
A planned local Hermes setup uses a 128GB 395+ AI Max PC. The expected usable VRAM is about 96GB, and the main question is which model should act as the everyday driver for Hermes. Hermes 4.3 36B and are the two model choices under consideration.
The setup may also add an Nvidia 4090 over USB4, so smaller models or can run fully offloaded from the main AMD system. The uncertain part is whether mixing an AMD setup with an external Nvidia card will be difficult or unstable.
Key points
- The target machine is a 128GB 395+ AI Max PC.
- The setup expects about 96GB of VRAM for use.
- Hermes 4.3 36B and are being considered as daily-driver models for Hermes.
- An Nvidia 4090 may be connected through USB4 for smaller models or .
- The main risk is whether an AMD system plus an external Nvidia card will work smoothly.