Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Unsloth GLM-5.2 – How to Run Locally. Parent comment
TPS = active weights in GB / your memory bandwidth.
That’s it for decode. That’s all.
There are no comments on this comment yet.
TPS = active weights in GB / your memory bandwidth.
That’s it for decode. That’s all.