News for hackers. Stuff that matters.
Re:Humanity isn't ready for the coming intelligence explosion by Retric on Tuesday June 16, 2026 @10:55AM (#48556257)
Companies game benchmarks, but sure they are better than nothing.
Re:Humanity isn't ready for the coming intelligence explosion by MattRix on Tuesday June 16, 2026 @08:33PM (#48564250)
I mean you wanted something objective, and they are. I don’t know why you’re being dismissive of them, they’re a huge element of what drives model development forward.

These companies aren’t just making stuff up, they really do want to improve the models, and the models really are improving.

Re:Humanity isn't ready for the coming intelligence explosion by Retric on Tuesday June 16, 2026 @09:13PM (#48564536)
> I don’t know why you’re being dismissive of them

I’m aware of multiple cases of benchmark cheating/“optimization”. So, taking benchmarks a face value seems laughable.