News for hackers. Stuff that matters.
Re:OpenAI Completes Deal That Values Company at $157B by lxgr on Wednesday October 02, 2024 @05:17PM (#41725054)
Revenue isn't profit. They're burning money at an impressive rate: https://www.nytimes.com/2024/09/27/technology/openai-chatgpt...

I wouldn't even be surprised if they were losing money on paying ChatGPT users on inference compute alone, and that isn't even factoring in the development of new models.

There was an interesting article here (can't find the link unfortunately) that was arguing that model training costs should be accounted for as operating costs, not investments, since last year's model is essentially a total write-off, and to stay competitive, an AI company needs to continue training newer frontier models essentially continuously.

Re:OpenAI Completes Deal That Values Company at $157B by Retric on Wednesday October 02, 2024 @05:41PM (#41725235)
Training costs scale to infinite users making them a perfect moat even if they need to keep updating it. Success would be 10-100x current users at which point training costs at the current scale just don’t matter.

Really their biggest risk is total compute costs falling too quickly or poor management.

Re:OpenAI Completes Deal That Values Company at $157B by ac29 on Wednesday October 02, 2024 @08:11PM (#41726121)
WSJ reported today that ChatGPT has 250M weekly users. 10x that would be nearly the the majority of internet users. 100x that would be significantly more than the population of Earth.
Re:OpenAI Completes Deal That Values Company at $157B by Retric on Wednesday October 02, 2024 @09:47PM (#41726555)
Someone can be a direct user, be on some companies corporate account, and an indirect user via 3rd parties using OpenAI on their backend.

As long as we’re talking independent revenue streams it’s worth counting separately from an investment standpoint.

Re:OpenAI Completes Deal That Values Company at $157B by lxgr on Wednesday October 02, 2024 @06:19PM (#41725480)
The potential user base seems quite finite to me, even under most optimistic assumptions.
Re:OpenAI Completes Deal That Values Company at $157B by Retric on Wednesday October 02, 2024 @07:36PM (#41725939)
Not everyone is going to pay 20$/month, but an optimistic trajectory is they largely replace search engines while acting as a back end for a huge number of companies.

I don’t think it’s very likely, but think of it like an auction. In a room with 100 people 99 of them should think the winner overpaid. In general most people should feel a given startup was overvalued and only looking back will some of these deals look like a good investment.

Re:OpenAI Completes Deal That Values Company at $157B by JamesBarney on Wednesday October 02, 2024 @05:48PM (#41725283)
> I wouldn't even be surprised if they were losing money on paying ChatGPT users on inference compute alone

I'd be surprised it that was the case. How many tokens is the average user going through? I'd be surprised if the avg user even hit a 1m tokens much less 20m.

Re:OpenAI Completes Deal That Values Company at $157B by MacsHeadroom on Wednesday October 02, 2024 @07:07PM (#41725744)
o1 is about $2-$4 per message over the API. I'm probably costing OpenAI less than 24hrs after my subscription renewal each month.

Voice mode is around $0.25 per minute via API. I don't use that much, but 3 minutes ago per day would already exceed the cost of a ChatGPT Plus subscription by quite a bit.

Re:OpenAI Completes Deal That Values Company at $157B by vintagedave on Thursday October 03, 2024 @12:16PM (#41732086)
> o1 is about $2-$4 per message over the API

I’m not sure I understand this, sorry. I see GPT-4o at $3.75 per million input tokens and $10 per million output tokens, on OpenAI’s pricing page.

That’s expensive and I can’t see how they can run Copilot on the standard API pricing. But, it makes a message (one interaction?) lower cost than $4 to me.

How many tokens are in a typical message for you?

Re:OpenAI Completes Deal That Values Company at $157B by lxgr on Wednesday October 02, 2024 @06:09PM (#41725414)
With o1? A lot.

Even for regular old 4o: You’re comparing to their API rates here, which might or might not cover their compute cost.

Re:OpenAI Completes Deal That Values Company at $157B by Mistletoe on Wednesday October 02, 2024 @09:46PM (#41726552)
Thought of this way makes AI companies remarkably similar to Bitcoin mining companies which always just barely stay ahead of the difficulty increases and often fail.
Re:OpenAI Completes Deal That Values Company at $157B by thedailymail on Wednesday October 02, 2024 @10:00PM (#41726614)
I think this might be the article you mentioned

https://benn.substack.com/p/do-ai-companies-work

Re:OpenAI Completes Deal That Values Company at $157B by lxgr on Thursday October 03, 2024 @01:58PM (#41733107)
That was it, thank you!