News for hackers. Stuff that matters.
Re:I'm making LLMs work on small and old devices by quickthoughts on Friday November 13, 2026 @09:33AM (#50484094)
rn just english but I have a welsh (cy) asr model cooking as well, though its still unusable (~25 WER). these tiny models are actually really cool example of distilling but also really really focusing on the engine in a way that takes advantage of crazy compression, decoding etc strategies

There are no comments on this comment yet.