News for hackers. Stuff that matters.
Re:$2 H100s: How the GPU Rental Bubble Burst by 0xDEAFBEAD on Friday October 11, 2024 @02:48AM (#41806926)
This guy claims they are losing billions of dollars on free ChatGPT users:

https://nitter.poast.org/edzitron/status/1841529117533208936

Re:$2 H100s: How the GPU Rental Bubble Burst by fragmede on Friday October 11, 2024 @05:29AM (#41807842)
Ed Zitron's analysis hinges on a lot of assumptions. Much of it comes down to the question of how much it actually costs to run a single inference of ChatGPT. That $20/month pro subscription could be a loss-leader or it could be making money, depending on the numbers you want to use. If you play with the numbers, and compare it to, say, $2/hr for an H100 currently on the front page, $20/$2/hr gets you 10 hours of GPU time before it costs more in hardware than your subscription, and then factoring in overhead on top, it's just not clear.
Re:$2 H100s: How the GPU Rental Bubble Burst by Aeolun on Saturday October 12, 2024 @06:25AM (#41818072)
You’d need to know how much they are using for that. I only use the API and the $20 I bought a year ago aren’t gone yet.