Re:I'm making LLMs work on small and old devices
by mrashad74 on Friday November 13, 2026 @01:09AM
(#50479030)
if you're having some cards already try to explore what people are doing with weight streaming and model compression, I got good results on older cards with far better models than the 16B
and the new thing will be "will it run qwen" :D