Huge 98GB AI model runs 3x faster on budget home PC
r/LocalLLaMAJul 16, 2026 · 1d ago
A user ran a massive 98GB (a quantized version of ) on a budget desktop with just a 6-core CPU, 16GB VRAM GPU (RTX 4060 Ti), and 138GB of RAM, splitting the workload between CPU and GPU. Using a recent build of llama.cpp (an ), a specific update between versions b9986 and b10034 tripled the generation speed, from 2 to 7 . This shows llama.cpp developers are actively improving for mixed CPU+GPU inference on consumer hardware.
Key points
A 98GB quantized model ran on a 6-core CPU plus a 16GB VRAM GPU
A specific llama.cpp build range tripled speed from 2 to 7
Running very large models locally without server-grade hardware is becoming more practical