Re:How to run Qwen 3.5 locally
by ac29 on Sunday March 08, 2026 @11:37AM
(#47298185)
ik_llama.cpp was about 2x faster for CPU inference of Qwen3.5 versus mainline until yesterday. Mainline landed a PR that greatly increased speed for Qwen3.5, so now ik_llama.cpp is only 10% faster on token generation.
[ Parent
| on HN ]
There are no comments on this comment yet.