News for hackers. Stuff that matters.
Re:I'm making LLMs work on small and old devices by mrashad74 on Friday November 13, 2026 @12:55AM (#50478913)
this kind of old processors are smth I want to explore honestly, I don't know if the processor capabilities will allow smth interesting to happen or not, but they're for sure on my target list.

I think realistically smth around 5tok/sec is possible with them for 2B models or so if you provided enough ram for streaming. worth a shot

There are no comments on this comment yet.