News for hackers. Stuff that matters.
Re:Show HN: I made a GPU VRAM calculator for transformer-bas... by alexhutcheson on Wednesday December 27, 2023 @03:42PM (#38786486)
Sincere question: Is installing and running a mini split actually cheaper than racking them in a colo, or paying for time on one of the GPU cloud providers?

Regardless, I can understand the hobby value of running that kind of rig at home.

Re:Show HN: I made a GPU VRAM calculator for transformer-bas... by oceanplexian on Wednesday January 03, 2024 @12:01AM (#38850934)
I personally haven’t done the calculation. I have rented colo space before and they are usually quite stingy on power. The other issue is, there’s a certain element to having GPUs around 24/7/365 to play with that I feel is fundamentally different than running it on a Cloud Provider. You’re not stressing out about every hour it’s running. I think in the long run (2yr+) it will be cheaper, and then you can swap in the latest and greatest GPU without any additional infrastructure cost.