News for hackers. Stuff that matters.

A comment on QuIP#: 2-bit Quantization for LLMs. Parent comment

Re:QuIP#: 2-bit Quantization for LLMs by patrakov on Sunday December 10, 2023 @11:34AM (#38592716)
No. The catch is that what's quantized here is not individual weights but groups of them.
[ Parent | on HN ]

There are no comments on this comment yet.