News for hackers. Stuff that matters.
Re:Do not buy RAM, compress by NegativeLatency on Thursday November 19, 2026 @11:23AM (#50562146)
https://github.com/microsoft/LLMLingua one such library I’m aware of

Tried porting it to swift, was hoping it would make mobile local models more useful for a project I was working on but it was hurting the accuracy too much. Can be very task dependent on how much you can compress. https://github.com/nburns/llmlingua-swift

There are no comments on this comment yet.