Re:I'm making LLMs work on small and old devices
by mrashad74 on Friday November 13, 2026 @09:31AM
(#50484059)
looks nice! what languages does it support?
[ Parent
| on HN ]
Re:I'm making LLMs work on small and old devices
by quickthoughts on Friday November 13, 2026 @09:33AM
(#50484094)
rn just english but I have a welsh (cy) asr model cooking as well, though its still unusable (~25 WER). these tiny models are actually really cool example of distilling but also really really focusing on the engine in a way that takes advantage of crazy compression, decoding etc strategies