Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

Re:Ggml.ai joins Hugging Face to ensure the long-term progre... by HPsquared on Friday February 20, 2026 @10:07AM (#47088923)

At a certain point the energy starts to cost more than renting some GPUs.

[ Parent | on HN ]

Re:Ggml.ai joins Hugging Face to ensure the long-term progre... by vardalab on Friday February 20, 2026 @12:48PM (#47091282)

Yeah, that is hard to argue with because I just go to OpenRouter and play around with a lot of models before I decide which ones I like. But there's something special about running it locally in your basement

[ Parent | on HN ]

Re:Ggml.ai joins Hugging Face to ensure the long-term progre... by dotancohen on Friday February 20, 2026 @08:09PM (#47096344)

I'd love to hear more about this. How do you decide that you like a model? For which use cases?

[ Parent | on HN ]

Re:Ggml.ai joins Hugging Face to ensure the long-term progre... by fc417fc802 on Friday February 20, 2026 @03:04PM (#47093165)

Aren't decent GPU boxes in excess of $5 per hour? At $0.20 per kWhr (which is on the high side in the US) running a 1 kW workstation 24/7 would work out to the same price as 1 hour of GPU time.

The issue you'll actually run into is that most residential housing isn't wired for more than ~2kW per room.

[ Parent | on HN ]