News for hackers. Stuff that matters.
Re:OpenAI declares 'code red' as Google catches up in AI race by NBJack on Wednesday December 03, 2025 @04:46AM (#46132469)
This assumes your model is static and never needs to be improved or updated.

Inference is cheap because the final model, despite its size, is ridiculously less resource intensive to use than it is to produce.

ChatGPT in its latest form isn't bad by any means, but it is falling behind. And that requires significant overhead, both to train and to iterate on model architecture. It is often a variable cost as well.

Re:OpenAI declares 'code red' as Google catches up in AI race by HDThoreaun on Wednesday December 03, 2025 @07:05AM (#46133540)
As long as revenue rises faster than training costs and inference remains profitable I dont think this is an issue. Eventually theyll be able to profitably amortize training across all the users.
Re:OpenAI declares 'code red' as Google catches up in AI race by lokar on Wednesday December 03, 2025 @11:29AM (#46136448)
Competition will erode how much they can charge for inference. This is all far from a sure thing.
Re:OpenAI declares 'code red' as Google catches up in AI race by gbalduzzi on Wednesday December 03, 2025 @11:55AM (#46136834)
> As long as revenue rises faster than training costs

And this is definitely not happening. They are covering training costs with investors money, and they can't really stop it without their competitors catching up