News for hackers. Stuff that matters.
Re:AI and Startup Moats by vb-8448 on Tuesday January 07, 2025 @08:08AM (#42621942)
> tl;dr: o3 managed to solve a problem it wasn’t trained on, with orders of magnitude better performance than other state of the art models

Is that true? They said that something called "o3-tuned" has been able to achieve the performance, what does "tuned" mean in this context?

Re:AI and Startup Moats by soiax on Tuesday January 07, 2025 @08:38AM (#42622153)
Yeah that's false.

from: https://arcprize.org/blog/oai-o3-pub-breakthrough

"Note on "tuned": OpenAI shared they trained the o3 we tested on 75% of the Public Training set. They have not shared more details. We have not yet tested the ARC-untrained model to understand how much of the performance is due to ARC-AGI data."