Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ...
by elif on Saturday January 04, 2025 @04:49PM
(#42597938)
My conjecture is that you still haven't proven that it didn't get the answer "right"
I have opened the question of why you thought jenever was not jenever, and your non-responsiveness I think compels the fact that AI was more correct in your contrived instance.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ...
by jorvi on Sunday January 05, 2025 @01:29PM
(#42603817)
If you add pear and spices to vodka, we call it liqueur and not pear-flavored vodka. So no, you are wrong. And the AI is wrong. But that is okay, if you want to enjoy leaning into the hype that's your choice.
I was just proving the people wrong that were saying akin to that o1 was "oneshotting every question".
I completely understand from how LLMs work that they wouldn't be able to get this right. But then people shouldn't be proudly be pronouncing that o1 (or any model) is getting every question right, first time.