Re:Ggml.ai joins Hugging Face to ensure the long-term progre...
by ryandrake on Friday February 20, 2026 @10:41AM
(#47089410)
I wasn't able to have very satisfying success until I bit the bullet and threw a GPU at the problem. Found an actually reasonably priced A4000 Ada generation 20GB GPU on eBay and never looked back. I still can't run the insanely large models, but 20GB should hold me over for a while, and I didn't have to upgrade my 10 year old Ivy Bridge vintage homelab.
[ Parent
| on HN ]
There are no comments on this comment yet.