Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on 1-Bit LLMs Could Solve AI's Energy Demands. Parent comment
Quantize each block or vector as a unit, bound to some metric instead of simply quantizing the whole thing all at once.
It's an interesting topic https://old.reddit.com/r/LocalLLaMA/comments/1ba55rj/overvie...
There are no comments on this comment yet.
Quantize each block or vector as a unit, bound to some metric instead of simply quantizing the whole thing all at once.
It's an interesting topic https://old.reddit.com/r/LocalLLaMA/comments/1ba55rj/overvie...