Re:Qwen 3.8 27B on my laptop can interpret model weights, too
by ActorNightly on Tuesday November 03, 2026 @04:10PM
(#50358238)
Architectures (like Gemma4) have things like sliding window attention that make it pretty impractical to do on a GPU, you would have to do additional things to make it work, and the talent to do that, even with LLM assistance is very small.
[ Parent
| on HN ]
Re:Qwen 3.8 27B on my laptop can interpret model weights, too
by clusterhacks on Tuesday November 03, 2026 @06:44PM
(#50359794)
Ah, that makes sense. I haven't bothered to look at current low-level NN architecture details. I'm a little surprised that there isn't a bumper crop of relatively well-informed talent to do gpgpu work. Although, when if I think about it, it has always been a little bit of a niche area.