Re:Memdoor: A team of 5 Qwen3.8-27B models beats Fable 5 on ...
by CamperBob2 on Saturday October 31, 2026 @09:24PM
(#50321899)
4x 96 GB runs the NVFP4 quants, which are indistinguishable from Q8 in real-world performance for this particular model. That's not always true but DeepSeek is unusually quantization-friendly. Also remember that a big chunk of the model consists of engrams that can live in system RAM or even on an SSD if necessary.
I imagine the various GGUFs are still pretty impressive, but haven't tried them myself.
I imagine the various GGUFs are still pretty impressive, but haven't tried them myself.