Re:Notes on OpenAI's new o1 chain-of-thought models
by ryanjshaw on Friday September 13, 2024 @04:05AM
(#41529047)
There is a trick. The "How is this possible?" primes the LLM that there is some kind of trick, as that phrase wouldn't exist in the training data outside of riddles and trick questions.
Re:Notes on OpenAI's new o1 chain-of-thought models
by hmottestad on Friday September 13, 2024 @06:11AM
(#41529743)
The trick in the original question is that it's a twist on the original riddle where the doctor is actually the boys mother. This is a fairly common riddle and I'm sure the LLM has been trained on it.
Re:Notes on OpenAI's new o1 chain-of-thought models
by bonoboTP on Friday September 13, 2024 @06:52AM
(#41529948)
Yes there is. The trick is that the more common variant of this riddle says that a boy and his father are in the car accident. That variant of the riddle certainly comes up a lot in the training data, which is directly analogous to the Schrödinger case from above where smuggling in the word "dead" is analogous to swapping father to mother in the car accident riddle.
I think many here are not aware that the car accident riddle is well known with the father dying where the real solution is indeed that the doctor is the mother.
The trick in yours also isn't a logic trick, it's a redirection, like a sleight of hand in a card trick.