News for hackers. Stuff that matters.
Re:QuIP#: 2-bit Quantization for LLMs by orbital-decay on Saturday December 09, 2023 @01:24AM (#38579194)
Functional? Sure, it will work. Useful? Unlikely. It would be surprising to see quantization of pretrained models to surpass the existing research around binary NNs (trained from scratch as 1-bit while using full precision for the most critical parts)

There are no comments on this comment yet.