News for hackers. Stuff that matters.
Re:Qwen3.6-35B-A3B: Agentic Coding Power, Now Open to All by deaux on Thursday April 16, 2026 @12:06PM (#47795449)
While they can be run locally, and most of the discussion on HN about that, I bet that if you look at total tok/day local usage is a tiny amount compared to total cloud inference even for these models. Most people who do use them locally just do a prompt every now and then.
Re:Qwen3.6-35B-A3B: Agentic Coding Power, Now Open to All by zozbot234 on Thursday April 16, 2026 @12:17PM (#47795648)
This is why I'd like to see a lot more focus on batched inference with lower-end hardware. If you just do a tiny amount of tok/day and can wait for the answer to be computed overnight or so, you don't really need top-of-the-line hardware even for SOTA results.
Re:Qwen3.6-35B-A3B: Agentic Coding Power, Now Open to All by deaux on Thursday April 16, 2026 @02:01PM (#47797185)
> If you just do a tiny amount of tok/day and can wait for the answer to be computed overnight or so

But they can't? The usage pattern is the polar opposite. Most people running these models locally just ask a few questions to it throughout the day. They want the answers now, or at least within a minute.

Re:Qwen3.6-35B-A3B: Agentic Coding Power, Now Open to All by zozbot234 on Thursday April 16, 2026 @02:49PM (#47797777)
If you want the answer right now, that alone ups your compute needs to the point where you're probably better off just using a free hosted-AI service. Unless the prompt is trivial enough that it can be answered quickly by a tiny local model.
Re:Qwen3.6-35B-A3B: Agentic Coding Power, Now Open to All by redman25 on Friday April 17, 2026 @05:48AM (#47804164)
A strix halo machine or MAC will run at less than 20watts idle. You could leave it running.
Re:Qwen3.6-35B-A3B: Agentic Coding Power, Now Open to All by mistercheese on Friday April 17, 2026 @12:15AM (#47802409)
That’s a good point. I think I saw Together.ai with that offering, but for some reason just never think to throw random non urgent coding tasks at it overnight