Re:QuIP#: 2-bit Quantization for LLMs
by orbital-decay on Saturday December 09, 2023 @01:24AM
(#38579194)
Functional? Sure, it will work. Useful? Unlikely. It would be surprising to see quantization of pretrained models to surpass the existing research around binary NNs (trained from scratch as 1-bit while using full precision for the most critical parts)
[ Parent
| on HN ]
There are no comments on this comment yet.