Re:Qwen3.6-35B-A3B: Agentic Coding Power, Now Open to All
by Glemllksdf on Thursday April 16, 2026 @11:52AM
(#47795187)
Isn't that some kind of gambling if you offload random experts onto the CPU?
Or is it only layers but that would affect all Experts?
Re:Qwen3.6-35B-A3B: Agentic Coding Power, Now Open to All
by dragonwriter on Thursday April 16, 2026 @12:22PM
(#47795724)
Pretty sure all partial offload systems I’ve seen work by layers, but there might be something else out there.
This model is a MoE model with only 3B active parameters per expert which works well with partial CPU offload. So in practice you can run the -A(N)B models on systems that have a little less VRAM than you need. The more you offload to the CPU the slower it becomes though.