News for hackers. Stuff that matters.
Re:GPT-5.2 by causal on Thursday December 11, 2025 @01:37PM (#46235180)
That ARC AGI score is a little suspicious. That's a really tough for AI benchmark. Curious if there were improvements to the test harness because that's a wild jump in general problem solving ability for an incremental update.
Re:GPT-5.2 by taurath on Thursday December 11, 2025 @01:50PM (#46235387)
I don’t think their words mean just about anything, only the behavior of the models.

Still waiting of Full Self Driving myself.

Re:GPT-5.2 by woeirua on Thursday December 11, 2025 @05:37PM (#46238284)
They're clearly building better training datasets and doing extensive RL on these benchmarks over time. The out of distribution performance is still awful.