News for hackers. Stuff that matters.
Re:1-Bit LLMs Could Solve AI's Energy Demands by acchow on Friday May 31, 2024 @05:14AM (#40532896)
Quantization isn’t a shortcut. It’s a test.

More training leads to better compression. Trimming precision off the integers reveals that there was more compression that could be had.

There are no comments on this comment yet.