News for hackers. Stuff that matters.
Re:Do not buy RAM, compress by pyaamb on Thursday November 19, 2026 @11:19AM (#50562081)
I wonder what the theoretical limits are of semantic compression for LLM input/output (eg. "Can you please send me the final report by Friday?" -> "Send final report by Friday." -> sr(FINAL, DEADLINE=FRIDAY)) that can still be recovered back to English
Re:Do not buy RAM, compress by NegativeLatency on Thursday November 19, 2026 @11:23AM (#50562146)
https://github.com/microsoft/LLMLingua one such library I’m aware of

Tried porting it to swift, was hoping it would make mobile local models more useful for a project I was working on but it was hurting the accuracy too much. Can be very task dependent on how much you can compress. https://github.com/nburns/llmlingua-swift