Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update
by yearolinuxdsktp on Saturday November 14, 2026 @10:06AM
(#50497600)
Is it possible to use these Qwen3.8-Flash-Next quants as a coding variant, with half the experts removed, like the ISTA-DASLAB Coder version? The performance and quality of that model is quite good when run with Splash and DFlash. But I wonder if there’s room left to improve, as the Coder model is I_Q3S variant, so it seems like doing 5 or 6-bit quants with half of experts removed might be even better. (And using the Dynamic v3.1 quantization)
[ Parent
| on HN ]
There are no comments on this comment yet.