Re:LLMs Are Cheap
by ddp26 on Monday June 09, 2025 @10:35AM
(#44224928)
I analyzed OpenAI API profitability in summer 2024 and found inference for gpt-4 class models likely pretty profitable, ~50% gross margins (ignoring capex for training models): https://futuresearch.ai/openai-api-profit
[ Parent
| on HN ]
That’s a little like saying you can compute the profitability of the energy market by looking only at the margins of gas stations. You can’t exclude all the outlays on actually acquiring the product to sell.
Sure - but is there any doubt in that example that gas stations are making a profit?
And unlike gasoline, once models are trained there is no significant ongoing production cost.
Models aren't static. In order for them to remain relevant, they have to be constantly retrained with new data. Plus there's a model arms race going on and which will probably continue for the foreseeable future.