News for hackers. Stuff that matters.

A comment on Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s. Parent comment

Re:Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac wit... by kamranjon on Tuesday September 01, 2026 @08:13PM (#49530124)
I am running 3.8 27b at q6 quant with 160k context on a 32gb video card (arc b70 pro) - I quantized the kv cache at q8 - that is the only trick really - works great.
[ Parent | on HN ]

There are no comments on this comment yet.