News for hackers. Stuff that matters.

A comment on Compress any LLM 3x in one click,near-lossless,in under 50 MB RAM.

Re:Compress any LLM 3x in one click,near-lossless,in under 5... by velox on Tuesday November 10, 2026 @09:28AM (#50440887)
I have not read the whole thing, but I'm not sure I understand the benefit of this vs. using an existing e.g. 4 bit quant of the model in question
[ Parent | on HN ]
Re:Compress any LLM 3x in one click,near-lossless,in under 5... by anushka_gandhi on Tuesday November 10, 2026 @09:31AM (#50440927)
For 4bit, it takes you 5-10 minutes to compress a model. With this, you can do that in seconds. You do not have to worry about tokenizer configuration or anything. Just one-click compress and run.

This is our first version and yes, it will have some errors that will be fixed in the upcoming versions.

[ Parent | on HN ]