News for hackers. Stuff that matters.
Re:$2 H100s: How the GPU Rental Bubble Burst by Aeolun on Friday October 11, 2024 @12:55AM (#41806299)
Isn’t OpenAI profitable if they stop training right at this moment? Just because they’re immediately reinvesting all that cash doesn’t mean they’re not profitable.
Re:$2 H100s: How the GPU Rental Bubble Burst by Attach6156 on Friday October 11, 2024 @01:12AM (#41806373)
And if they stop training right now their "moat" (which I think is only o1 as of today) would last a good 3 to 6 months lol, and then to the Wendy's it is.
Re:$2 H100s: How the GPU Rental Bubble Burst by Aeolun on Friday October 11, 2024 @02:47AM (#41806913)
That is similarly true for all other AI companies. It’s why they don’t do that. But everyone is still happy to give them more money because their offering is good as it is.
Re:$2 H100s: How the GPU Rental Bubble Burst by wyclif on Sunday October 13, 2024 @09:42PM (#41833421)
>and then to the Wendy's it is

I didn't really catch that pop culture reference. What does that mean?

Re:$2 H100s: How the GPU Rental Bubble Burst by slater on Sunday October 13, 2024 @09:43PM (#41833428)
My guess: The competition catches up, you lose all paying clients, and you get to apply for jobs at Wendy's...?
Re:$2 H100s: How the GPU Rental Bubble Burst by wyclif on Monday October 14, 2024 @07:34PM (#41843345)
Or does it mean it's a trivial decision, as trivial as deciding what fast food joint to choose?
Re:$2 H100s: How the GPU Rental Bubble Burst by slater on Monday October 14, 2024 @08:56PM (#41843850)
Guess we'll never know :(
Re:$2 H100s: How the GPU Rental Bubble Burst by 0xDEAFBEAD on Friday October 11, 2024 @02:48AM (#41806926)
This guy claims they are losing billions of dollars on free ChatGPT users:

https://nitter.poast.org/edzitron/status/1841529117533208936

Re:$2 H100s: How the GPU Rental Bubble Burst by fragmede on Friday October 11, 2024 @05:29AM (#41807842)
Ed Zitron's analysis hinges on a lot of assumptions. Much of it comes down to the question of how much it actually costs to run a single inference of ChatGPT. That $20/month pro subscription could be a loss-leader or it could be making money, depending on the numbers you want to use. If you play with the numbers, and compare it to, say, $2/hr for an H100 currently on the front page, $20/$2/hr gets you 10 hours of GPU time before it costs more in hardware than your subscription, and then factoring in overhead on top, it's just not clear.
Re:$2 H100s: How the GPU Rental Bubble Burst by Aeolun on Saturday October 12, 2024 @06:25AM (#41818072)
You’d need to know how much they are using for that. I only use the API and the $20 I bought a year ago aren’t gone yet.