To 16GB VRAM users, plug in your old GPU

For those who want to run latest dense ~30b models and only have 16GB VRAM, if you have a old card with 6GB VRAM or more, plug it in. It matters that everything fits on the VRAM, even on 2 cards. Even if one of them is quite weak. I have a 5070Ti 16GB and a old 2060 6GB. The common idea is you need 2 same GPU to maximize performance. But one day I was strike by the idea, why not give it a try? Let's see, if you did not bought a mother board just for LLM, it's very possible you have a true PCI-E

More from Reddit

‘Existential Risk’: Western Car Companies Are Blowing The Software Race

Reddit

Iran court upholds death sentence for protester, 25-year term for daughter

Reddit

Apple, Google crushed California bill that helped smaller rivals

Reddit

Luce DFlash: Qwen3.6-27B at up to 2x throughput on a single RTX 3090

Reddit

GBNF grammar tweak for faster Qwen3.6 35B-A3B and Qwen3.6 27B

Reddit

Tissue regeneration moves closer to reality with lab-grown bone, muscle, and cartilage

Reddit