News for hackers. Stuff that matters.
Re:$2 H100s: How the GPU Rental Bubble Burst by fragmede on Friday October 11, 2024 @05:29AM (#41807842)
Ed Zitron's analysis hinges on a lot of assumptions. Much of it comes down to the question of how much it actually costs to run a single inference of ChatGPT. That $20/month pro subscription could be a loss-leader or it could be making money, depending on the numbers you want to use. If you play with the numbers, and compare it to, say, $2/hr for an H100 currently on the front page, $20/$2/hr gets you 10 hours of GPU time before it costs more in hardware than your subscription, and then factoring in overhead on top, it's just not clear.

There are no comments on this comment yet.