News for hackers. Stuff that matters.
Re:Sub-1-Bit LLM Compression via Latent Factorization by big-chungus4 on Thursday October 08, 2026 @12:28PM (#50007904)
Can this produce a useful model? So far 1 bit quants have been less useful than smaller models that use the same memory
Re:Sub-1-Bit LLM Compression via Latent Factorization by tcdent on Thursday October 08, 2026 @01:40PM (#50009093)
I don't think it's trying to be a useful implementation, but the significance they do provide is that they are able to improve on the relative loss at lower quants.

So, not something anyone would want to run currently, but an indicator that there is still more to squeeze out of lower precisions.

Trellis quantization is a far more approachable enhancement right now, but it doesn't cross the 1-bit barrier (and perhaps doesn't intend to).

Re:Sub-1-Bit LLM Compression via Latent Factorization by GaggiX on Thursday October 08, 2026 @12:38PM (#50008056)
I recently found this 1.58-bit model for ASR and it's surprising good (and very fast), that being said it's not a LLM.

https://huggingface.co/moondream/parakeet-redux