News for hackers. Stuff that matters.
Re:Nvidia on NixOS WSL – Ollama up 24/7 on your gaming PC by borisk on Friday April 11, 2025 @05:57AM (#43652208)
How is it a waste of money if a lot of people, including the author of the article, already have an nVidia GPU in their PC?

Running locally has a lot of advantages - privacy, getting to learn how to run LLMs, not having to deal with quotas, logins, outages.

Re:Nvidia on NixOS WSL – Ollama up 24/7 on your gaming PC by hu3 on Friday April 11, 2025 @08:19AM (#43652969)
Home electricity bill of a decent GPU alone is usually more expensive than renting GPUs on demand.
Re:Nvidia on NixOS WSL – Ollama up 24/7 on your gaming PC by borisk on Friday April 11, 2025 @09:21AM (#43653472)
Do you have any numbers to back that statement up?

E.g. I have solar panels and a home battery and pay less than a $100 a year for electricity.

Re:Nvidia on NixOS WSL – Ollama up 24/7 on your gaming PC by hu3 on Friday April 11, 2025 @11:47AM (#43655188)
Solar panels aren't free. And aren't hassle-free either.

I wouldn't even bring that into the equasion since a large part of the population can't use solar panels.

Not to mention GPU value depreciation.