News for hackers. Stuff that matters.
Re:GLM-5.2 is the new leading open weights model on Artifici... by scrlk on Wednesday June 17, 2026 @10:46AM (#48571282)
I've seen a few articles from providers talking about KV cache quantisation, but it's not something they explicitly point out like they do with weights.

So you could end up paying more for unquantised weights, only to get silently hit with a quantised KV cache...

There are no comments on this comment yet.