- Prices of API access of Open models from third-party providers who would have no motive to subsidize inference
- Google says their median query is about as expensive as a google search
Thing is, what you're saying would have been true a few years ago. This would have all been intractable. But llm inference costs have quite literally been slashed several orders of magnitude in the last couple of years.
I've replied to you once man. Feel free to disengage but let's not act like this has been some ongoing debate. No need to make up stories.
Again, there are many indicators that inference per user is cheap. Even the sheer fact that Open AI closed 2024 serving hundreds of millions of users and lost 'only' 5B is a pretty big clue that inference is not that expensive.
They are gaining everywhere. Some more than others, but to say they are only gaining in poorer markets is blatantly untrue.
>FB global ARPU is about 50 USD. At 700M customers, they do 35B in revenue annually.
Yeah, and that would make them healthily profitable.
>This compares to a publicly stated expected cost of approximately 150B in computing alone over the next 5 years
Yes, because they expect to serve hundreds of millions to potentially billions more users. 'This leaves a profit of 5B per year' makes some very bizarre assumptions. You’re conflating a future-scale spending projection with today’s economics. That number is a forward-looking projection tied to massive scale - it doesn’t prove current users alone justify that spend, and they clearly don't. There is no reality where they are spending that much if their userbase stalls at today's numbers, so it's just a moot point and '5B per year' a made up number.
>Fundamentally, OpenAI does not have the unit economics of a traditional SaaS.
Again, Everything points to their unit economics being perfectly fine.