Re:I'm making LLMs work on small and old devices
by mrashad74 on Thursday November 12, 2026 @04:43PM
(#50474734)
No one will run a slopped 600M or even 16B for anything serious today, the whole goal is to experiment, to push both limits of what can be done with the model, and the hardware itself.
It's fun times actually. And I think such experiments and others posted are both showcasing the limits people are pushing.
It's fun times actually. And I think such experiments and others posted are both showcasing the limits people are pushing.