News for hackers. Stuff that matters.
Re:I'm making LLMs work on small and old devices by mrashad74 on Friday November 13, 2026 @04:48AM (#50480877)
I'm also working on this thread in parallel because it has interesting business aspects, would be happy to see your progress when you release it
Re:I'm making LLMs work on small and old devices by bArray on Friday November 13, 2026 @10:21AM (#50484856)
For me it's just about empowering people to jump on this LLM bandwagon with minimal resources. I'm not expecting top tier work, but I can already sent it off to check the weather on a certain day, or build a small Python GUI. There's still cases where it struggles and cannot recover - which is where I'm actively trying to improve it - without implementing some kind of case-by-case solution.