News for hackers. Stuff that matters.
Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by astrange on Thursday October 31, 2024 @04:25AM (#42004561)
Minor edits to well known problems do easily fool current models though. Here's one 4o and o1-mini fail on, but o1-preview passes. (It's the mother/surgeon riddle so kinda gore-y.)

https://chatgpt.com/share/6723477e-6e38-8000-8b7e-73a3abb652...

https://chatgpt.com/share/6723478c-1e08-8000-adda-3a378029b4...

https://chatgpt.com/share/67234772-0ebc-8000-a54a-b597be3a1f...

Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by _flux on Thursday October 31, 2024 @04:55AM (#42004711)
I think you didn't use the "share" function; I cannot open any of these links. Can you do it in a private browser session (so you're not logged in)?
Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by astrange on Thursday October 31, 2024 @05:03AM (#42004754)
Oops, fixed the links.

mini's answer is correct, but then it forgets that fathers are male in the next sentence.