Re:I'm making LLMs work on small and old devices
by quickthoughts on Friday November 13, 2026 @09:33AM
(#50484094)
rn just english but I have a welsh (cy) asr model cooking as well, though its still unusable (~25 WER). these tiny models are actually really cool example of distilling but also really really focusing on the engine in a way that takes advantage of crazy compression, decoding etc strategies
[ Parent
| on HN ]
There are no comments on this comment yet.