A search for China-bought GPUs to run large AI models
A China trip is being used as a chance to look for Chinese s or that can run large locally. The main need is plenty of memory, not cutting-edge speed. The hardware should work with tools such as vLLM or .
Some setup trouble is acceptable. Huawei cards are mentioned as a possible alternative to buying more Nvidia hardware.
Key points
- The goal is to buy hardware in China for large AI model .
- High memory matters more than top speed.
- The hardware needs support from vLLM or .
- Manual setup and troubleshooting are acceptable.
- Huawei cards are being considered as an Nvidia alternative.