News for hackers. Stuff that matters.
Re:Notes on OpenAI's new o1 chain-of-thought models by prog_1 on Friday September 13, 2024 @08:39AM (#41530659)
ie when you cant beat them, make new metrics

and you can absolutely evaluate how smart someone is in a 2min casual conversation. You wont be able to tell how well they are in some niche topic, but %insert something about different flavors of intelligence and how they do not equate do subject matter expertise%

Re:Notes on OpenAI's new o1 chain-of-thought models by skybrian on Friday September 13, 2024 @12:47PM (#41532920)
It’s a common pattern that AI benchmarks get too easy, so they make new ones that are harder.