News for hackers. Stuff that matters.
Re:LLMs Are Cheap by ddp26 on Monday June 09, 2025 @10:35AM (#44224928)
I analyzed OpenAI API profitability in summer 2024 and found inference for gpt-4 class models likely pretty profitable, ~50% gross margins (ignoring capex for training models): https://futuresearch.ai/openai-api-profit
Re:LLMs Are Cheap by otterley on Monday June 09, 2025 @10:39AM (#44224962)
That’s a little like saying you can compute the profitability of the energy market by looking only at the margins of gas stations. You can’t exclude all the outlays on actually acquiring the product to sell.
Re:LLMs Are Cheap by lazide on Monday June 09, 2025 @02:09PM (#44227325)
Sure - but is there any doubt in that example that gas stations are making a profit?

And unlike gasoline, once models are trained there is no significant ongoing production cost.

Re:LLMs Are Cheap by otterley on Monday June 09, 2025 @04:28PM (#44229087)
Models aren't static. In order for them to remain relevant, they have to be constantly retrained with new data. Plus there's a model arms race going on and which will probably continue for the foreseeable future.
Re:LLMs Are Cheap by lazide on Tuesday June 10, 2025 @04:55AM (#44234280)
Fair point - though various distilling and retraining tricks do reduce the cost quite a bit. It’s not like everyone is doing all the work they had to do from scratch, every time.