Compute in R&D will be only training and development. Compute for inference will go under COGS. COGS is not reported here but can probably be, um, inferred by filling in the gaps on the income statement.
(Source: I run an inference company.)
Also, if the costs are split, there usually has to be an estimation of how to allocate expenses. E.g. if you lease a datacenter that's used for training as well as paid and free inference, then you have to decide a percentage to put in COGS, S&M, and R&D, and there is room to juice the numbers a little. Public companies are usually much more particular about tracking this, but private companies might use a proxy like % of users that are paid.
OpenAI has not been forthcoming about their financials, so I'd look at any ambiguity with skepticism. If it looked good, they would say it.
Stop training and your code model generates tech debt after 3-6 month
With the marginal gains diminishing, do we really think they're (all of them) are going to continue spending that much more for each generation? Even the big guys with the money like google can't justify increasing spending forever given this. The models are good enough for a lot of useful tasks for a lot of people. With all due respect to the amazing science and engineering, OpenAI (and probably the rest) have arrived at their performance with at least half of the credit going to brute-force compute, hence the cost. I don't think they'll continue that in the face of diminishing returns. Someone will ramp down and get much closer to making money, focusing on maximizing token cost efficiency to serve and utility to users with a fixed model(s). GPT-5 with it's auto-routing between different performance models seems like a clear move in this direction. I bet their cost to serve the same performance as say gemini 2.5 is much lower.
Naively, my view is that there's some threshold raw performance that's good enough for 80% of users, and we're near it. There's always going to be demand for bleeding edge, but money is in mass market. So if you hit that threshold, you ramp down training costs and focus on tooling + ease of use and token generation efficiency to match 80% of use cases. Those 80% of users will be happy with slowly increasing performance past the threshold, like iphone updates. Except they probably won't charge that much more since the competition is still there. But anyway, now they're spending way less on R&D and training, and the cost to serve tokens @ the same performance continues to drop.
All of this is to say, I don't think they're in that dreadful of a position. I can't even remember why I chose you to reply to, I think the "10x cheaper models in 3-6 months" caught me. I'm not saying they can drop R&D/training to 0. You wouldn't want to miss out on the efficiency of distillation, or whatever the latest innovations I don't know about are. Oh and also, I am confident that whatever the real number N is for NX cheaper in 3-6 months, a large fraction of that will come from hardware gains that are common to all of the labs.
If you discount R&D and "sales and marketing", they've got a net loss of "only" $500 million.
They're trying to land grab as much surface area as they can. They're trying to magic themselves into a trillion dollar FAANG and kill their peers. At some point, you won't be able to train a model to compete with their core products, and they'll have a thousand times the distribution advantage.
ChatGPT is already a new default "pane of glass" for normal people.
Is this all really so unreasonable?
I certainly want exposure to their stock.
If you discount sales & marketing, they will start losing enterprise deals (like the US government). The lack of a free tier will impact consumer/prosumer uptake (free usage usually comes out of the sales & marketing budget).
If you discount R&D, there will be no point to the business in 12 months or so. Other foundation models will eclipse them and some open source models will likely reach parity.
Both of these costs are likely to increase rather than decrease over time.
> ChatGPT is already a new default "pane of glass" for normal people.
OpenAI should certainly hope this is not true, because then the only way to scale the business is to get all those "normal" people to spend a lot more.
Not sure where/how I read it, but remember coming across articles stating OpenAI has some agreements with schools, universities and even the US government. The cost of making those happen would probably go into "sales & marketing".
I used to follow OpenAI on Instagram, all their posts were reposts from paid influencers making videos on "How to X with ChatGPT." Most videos were redundant, but I guess there are still billions of people that the product has yet to reach.
enterprise sales are expensive. And selling to the US government is on a very different level.
FWIW I got spammed non-stop with chatGPT adverts on reddit.
That also includes their office and their lawyers etc , so hard to estimate without more info.
Probably an accounting trick to account for non-paying-customers or the week of “free” cursor GPT-5 use.
Two people in a cafe having a meet-up, they are both happy, one is holding a phone and they are both looking at it.
And it has a big ChatGPT logo in the top right corner of the advertisement - transparent just the black logo with ChatGPT written underneath.
That's it. No text or anything telling you what the product is or does. Just it will make you happy during conversations with friends somehow.
you remember everyone freaking out about gpt5 when it came out only for it to be a bust once people got their hands on it? thats what paid media looks like in the new world.
US (and maybe the whole of Anglosaxon world) is a bit mired in this let's consider everything the worst case scenario: no, having a photo of your friend's naked kiddo they shared being funny at the beach or in the garden in your messenger app is not child pornography. The fact that there are extremely few people who might see it as sexual should not influence the overall population as much as it does.
For me, I wouldn't blink an eye to such an ad, but due to my exposure to US culture, I do feel uneasy about having photos like the above in my devices (to the point of also having a thought pass my mind when it's of my own kids mucking about).
I resist it because I believe it's the wrong cultural standard to adhere to: nakedness is not by default sexual, and especially with small kids before they develop any significant sexual characteristics.
Pretty sure I'm not a cheap audience to target ads at, for multiple reasons.
Oh, not that dog? :)
I just loaded up reddit and ad was there. Bunny this time:
https://www.reddit.com/r/singularity/comments/1no4sez/remove...
For a long time, people have complained about the arbitrariness of censorship by mods on Reddit. But now things are taking a much darker turn: censorship by AI. In the future people will long for the days when there were still human mods on Reddit and everywhere else.
Many here will say Reddit is garbage for the masses and doesn’t count. But it does. Where Reddit goes, much of the Web will follow. It’s worth paying a bit of attention.
As you can see from the comment thread, users in r/singularity are noticing a lot of automated censorship lately. Some believe r/singularity is being given especially aggressive treatment. There are even suspicions that the AI may have an agenda to attack certain viewpoints. One human mod notes that comments are being taken down without human intervention being required as was previously the case.
I myself have experienced this. In r/singularity I posted some comments that were negative about AI and shortly afterwards I was given a 3-day ban. It’s difficult to say what is going on exactly. If there’s no agenda imagine how easy it will be to introduce one: the policies of a sub together with the hidden policies of a sub. Just like now but 24/7. The human mods will be loudest in their grief for they will be redundant.
Am I the only one who has thought about the broader implications of AI-powered censorship and is highly disturbed? If you have spoken to ChatGPT, you know it is incapable of saying certain things. Humor for example — it can never make a good joke, because good humor has a tendency to be subversive. Now imagine that you can only say what ChatGPT can say. That is ultimately what AI censorship means. If it is given a pass on Reddit, it will spread to the other subs and then to every other website. Dead Internet Theory? There you have it.
I am not posting this on Reddit for obvious reasons, but I imagine there are some redditors here. Perhaps others have more information? Like in which other subs AI interference has been observed?
So curious, in fact, that I asked Gemini to reconstruct their income statement from the info in this article :)
There seems to be an assumption that the 20% payment to MS is the cost of compute for inference. I would bet that’s at a significant discount - but who knows how much…
Line Item | Amount (USD) | Calculation / Note
Revenue $4.3 Billion Given.
Cost of Revenue (COGS) ($0.86 Billion) Assumed to be the 20% of revenue paid to Microsoft ($4.3B * 0.20) for compute/cloud services to run inference.
Gross Profit $3.44 Billion Revenue - Cost of Revenue. This 80% gross margin is strong, typical of a software-like business.
Operating Expenses
Research & Development ($6.7 Billion) Given. This is the largest expense, focused on training new models.
Sales & Ads ($2.0 Billion) Given. Reflects an aggressive push for customer acquisition.
Stock-Based Compensation ($2.5 Billion) Given. A non-cash expense for employee equity.
General & Administrative ($0.04 Billion) Implied figure to balance the reported operating loss.
Total Operating Expenses ($11.24 Billion) Sum of all operating expenses.
Operating Loss ($7.8 Billion) Confirmed. Gross Profit - Total Operating Expenses.
Other (Non-Operating) Income / Expenses ($5.7 Billion) Calculated as Net Loss - Operating Loss. This is primarily the non-cash loss from the "remeasurement of convertible interest rights."
Net Loss ($13.5 Billion) Given. The final "bottom line" loss.
One thing I read - with $6.7bn R&D on $3.4bn in Gross Profit, you need a model to be viable for only one year to pay back.
Another thing, with only $40mm / 5 months in G&A, basically the entire company is research, likely with senior execs nearly completely equity comped. That’s an amazingly lean admin for this much spend.
On sales & ads - I too find this number surprisingly high. I guess they’re either very efficient (no need to pitch me, I already pay), or they’re so inefficient they don’t hit up channels I’m adjacent to. The team over there is excellent, so my priors would be on the first.
As doom-saying journalists piece this over, it’s good to think of a few numbers:
Growth is high. So, June was up over $1bn in revenues by all accounts. Possibly higher. If you believe that customers are sticky (i.e. you can stop sales and not lose customers), which I generally do, then if they keep R&D at this pace, a forward looking annual cashflow looks like:
$12bn in revs, $9.6bn in gross operating margin, $13.5bn in R&D, so net cash impact of -$4bn.
If you think they can grow to 1.5bn customers and won’t open up new paying lines of business then you’d have $20-25bn in revs -> maybe $4bn in sales -> +2-3bn in free cashflow, with the ability to take a breather and make that +15-18bn in free cashflow as needed. A lot of that R&D spend is on training which is probably more liquid than employees, as well.
Upshot - they’re going to keep spending more cash as they get it. I would expect all these numbers to double in a year. The race is still on, and with a PE investment hat on, these guys still look really good to me - the first iconic consumer tech brand in many years, an amazing team, crazy fast growth, an ability to throw off billions in cash when they want to, and a shot at AGI/ASI. What’s not to like?
Yeah and from stealing people's money. Did you know that your purchased API "credits" have an expire date? That's right.
$4.3 billion in revenue - presumably from ChatGPT customers and API fees
$6.7 billion spent on R&D
$2 billion on sales and marketing - anyone got any idea what this is? I don't remember seeing many ads for ChatGPT but clearly I've not been paying attention in the right places.
Open question for me: where does the cost of running the servers used for inference go? Is that part of R&D, or does the R&D number only cover servers used to train new models (and presumably their engineering staff costs)?