News for hackers. Stuff that matters.
Re:Unsloth GLM-5.2 – How to Run Locally by dannyw on Monday June 22, 2026 @11:27PM (#48639874)
Correct. The main bottleneck with LLM inference is, and have always been, memory bandwidth.

TPS = active weights in GB / your memory bandwidth.

That’s it for decode. That’s all.

There are no comments on this comment yet.