News for hackers. Stuff that matters.
Re:I'm making LLMs work on small and old devices by mrashad74 on Friday November 13, 2026 @01:09AM (#50479030)
if you're having some cards already try to explore what people are doing with weight streaming and model compression, I got good results on older cards with far better models than the 16B

and the new thing will be "will it run qwen" :D

There are no comments on this comment yet.