News for hackers. Stuff that matters.

A comment on Qwen 3.8 27B on my laptop can interpret model weights, too. Parent comment

Re:Qwen 3.8 27B on my laptop can interpret model weights, too by pxmpxm on Tuesday November 03, 2026 @07:20PM (#50360075)
Err strata is just a fork of llama cpp with fancier uis, right?
[ Parent | on HN ]
Re:Qwen 3.8 27B on my laptop can interpret model weights, too by MadameMinty on Tuesday November 03, 2026 @07:57PM (#50360300)
Strata manages MoE expert offloading completely differently, which for QFN means ludicrous speed.
[ Parent | on HN ]