Re:Do not buy RAM, compress
by pyaamb on Thursday November 19, 2026 @11:19AM
(#50562081)
I wonder what the theoretical limits are of semantic compression for LLM input/output (eg. "Can you please send me the final report by Friday?" -> "Send final report by Friday." -> sr(FINAL, DEADLINE=FRIDAY)) that can still be recovered back to English
[ Parent
| on HN ]
Re:Do not buy RAM, compress
by NegativeLatency on Thursday November 19, 2026 @11:23AM
(#50562146)
https://github.com/microsoft/LLMLingua one such library I’m aware of
Tried porting it to swift, was hoping it would make mobile local models more useful for a project I was working on but it was hurting the accuracy too much. Can be very task dependent on how much you can compress. https://github.com/nburns/llmlingua-swift