News for hackers. Stuff that matters.
Re:Notes on OpenAI's new o1 chain-of-thought models by fragmede on Friday September 13, 2024 @02:05AM (#41528408)
what's weird is it gets it right when I try it.

https://chatgpt.com/share/66e3601f-4bec-8009-ac0c-57bfa4f059...

Re:Notes on OpenAI's new o1 chain-of-thought models by latexr on Friday September 13, 2024 @03:23AM (#41528822)
That’s not weird at all, it’s how LLMs work. They statistically arrive at an answer. You can ask it the same question twice in a row in different windows and get opposite answers. That’s completely normal and expected, and also why you can never be sure if you can trust an answer.
Re:Notes on OpenAI's new o1 chain-of-thought models by brna-2 on Friday September 13, 2024 @02:55AM (#41528676)
Waat, got it on second try:

This is possible because the doctor is the boy's other parent—his father or, more likely given the surprise, his mother. The riddle plays on the assumption that doctors are typically male, but the doctor in this case is the boy's mother. The twist highlights gender stereotypes, encouraging us to question assumptions about roles in society.

Re:Notes on OpenAI's new o1 chain-of-thought models by brna-2 on Friday September 13, 2024 @02:41AM (#41528605)
Re:Notes on OpenAI's new o1 chain-of-thought models by rtakha on Friday September 13, 2024 @06:52AM (#41529947)
Perhaps OpenAI hot-patches the model for HN complaints:

  def intercept_hn_complaints(prompt):
    if is_hn_trick_prompt(prompt):
       # special_case for known trick questions.
Re:Notes on OpenAI's new o1 chain-of-thought models by fragmede on Friday September 13, 2024 @04:32PM (#41534852)
While that's not impossible, what we know of how the technology works (ie very costly training run followed by cheap inference steps) means that's not feasible, given all the possible variations of the question * is_hn_trick_prompt* would have to cover because there's a near infinite variations on how you'd word the prompt. (Eg The first sentence could be reworded to be "A woman and her son are in a car accident. " to "A woman and her son are in the car when they get into a crash.")