Checking if many GPUs are enough to run Qwen locally

Someone wants to run Qwen on their own computer and asks whether a 13-GPU setup is enough. The listed setup is 11 RTX 3090 cards, 1 RTX 5090 card, and 1 RTX 5060 Ti card.

The practical question is whether this hardware can run a without paying cloud or API costs. The exact Qwen model size, method, software setup, and target speed are not given.

Key points

  • The item asks whether Qwen can run locally on a large GPU setup.
  • The listed hardware is 11 RTX 3090 cards, 1 RTX 5090 card, and 1 RTX 5060 Ti card.
  • There is not enough detail to judge exact or fit.
  • Local running may cut API costs, but hardware and electricity costs still matter.
Read original