News for hackers. Stuff that matters.
Re:OpenAI declares 'code red' as Google catches up in AI race by mrweasel on Wednesday December 03, 2025 @04:53AM (#46132526)
If pre-training is just training, then how on earth can OpenAI not have "a successful pre-training run"? The word successful indicates that they tried, but failed.

It might be me misunderstanding how this works, but I assumed that the training phase was fairly reproducible. You might get different results on each run, do to changes in the input, but not massively so. If OpenAI can't continuously and reliably train new models, then they are even more overvalued that I previously assumed.

Re:OpenAI declares 'code red' as Google catches up in AI race by nodja on Wednesday December 03, 2025 @05:35AM (#46132868)
Because success for them doesn't mean it works, it means it works much better than what they currently have. If a 1% improvement comes at the cost of spending 10x more on training and 2x more on inference then you're failing at runs. (numbers out of ass)
Re:OpenAI declares 'code red' as Google catches up in AI race by mrweasel on Wednesday December 03, 2025 @06:20AM (#46133188)
That makes sense. It's not that the training didn't complete or returned a moronic model, but the capabilities have plateaued.
Re:OpenAI declares 'code red' as Google catches up in AI race by immibis on Wednesday December 03, 2025 @05:07AM (#46132641)
Maybe this has something to do with why they're declaring "code red".