Re:Show HN: I made a GPU VRAM calculator for transformer-bas...
by oceanplexian on Wednesday January 03, 2024 @12:01AM
(#38850934)
I personally haven’t done the calculation. I have rented colo space before and they are usually quite stingy on power. The other issue is, there’s a certain element to having GPUs around 24/7/365 to play with that I feel is fundamentally different than running it on a Cloud Provider. You’re not stressing out about every hour it’s running. I think in the long run (2yr+) it will be cheaper, and then you can swap in the latest and greatest GPU without any additional infrastructure cost.
Regardless, I can understand the hobby value of running that kind of rig at home.