Re:Qwen4-Max
by teaearlgraycold on Sunday November 15, 2026 @11:52PM
(#50514176)
I'm also hoping someone puts out a competitive 30-70B model soon. There's this massive dead zone between 24GB and <100GB of VRAM where it seems your best option is Qwen 3.8 27B.
[ Parent
| on HN ]
Re:Qwen4-Max
by shockembopper on Sunday November 15, 2026 @11:58PM
(#50514214)
There are many engines that alleviate this issue in particular. The current mood is running qwen flash next using strata, basalt, ect.
Re:Qwen4-Max
by AtHeartEngineer on Monday November 16, 2026 @08:15AM
(#50517286)
radiance
Same, I recently found Nemotron 3.5 74B-A9B really good at filling this gap though, could do (very slow) local inference on just 32GB DDR4, without the quality dropping to the floor
Re:Qwen4-Max
by samtheprogram on Monday November 16, 2026 @09:59AM
(#50518297)
[delayed]
Re:Qwen4-Max
by seanmcdirmid on Monday November 16, 2026 @11:55AM
(#50519766)
Qwen 3.8 27B is a dense model, so prefill times kind of suck on Mac’s. MoE models offer way more value unless yiu have the bandwidth to handle a dense model.