News for hackers. Stuff that matters.
Re:Lossless LLM compression for efficient GPU inference via ... by zorgmonkey on Friday April 25, 2025 @08:43PM (#43799888)
I don't know of any great write-ups unfortunately, but the rANS you're looking for is range asymmetric numeral systems.
Re:Lossless LLM compression for efficient GPU inference via ... by eln1 on Sunday April 27, 2025 @02:29AM (#43809865)
There are lots of materials about ANS, e.g. gathered here: https://encode.su/threads/2078-List-of-Asymmetric-Numeral-Sy...