Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s

Re:Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac wit... by whartung on Tuesday September 01, 2026 @01:38PM (#49525192)

I'm hoping to see progress in this space.

Folks talking about how 32G is not enough for local use, but then there's been work like this to empower it.

My hope is that the new 32G M6 will be "useful" locally, possibly because of work like this.

[ Parent | on HN ]

Re:Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac wit... by tyre on Tuesday September 01, 2026 @03:45PM (#49527085)

Yes, but also 12 tok/s versus Claude is so far from comparable. I know that it’s not exactly 1:1, but it’s a long way from an easy trade-off, especially considering hardware prices for high levels of RAM.

[ Parent | on HN ]

Re:Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac wit... by carloslfu on Tuesday September 01, 2026 @01:51PM (#49525356)

yes! I'm bullish on this. there is a lot of work to do. I've been experimenting with pruning, distillation, and retraining too. I'm sure your 32gb m6 will run a badass local model!

[ Parent | on HN ]

Re:Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac wit... by trollbridge on Tuesday September 01, 2026 @05:16PM (#49528323)

32GB is simply too tight; you need 8 minimum for the OS and you need about 4-8 more for the LLM you’re visiting and kv cache.

[ Parent | on HN ]