News for hackers. Stuff that matters.
Re:What Is ChatGPT Doing and Why Does It Work? by hoosieree on Tuesday June 18, 2024 @01:25PM (#40720124)

    > Surely nothing in the prompt directly triggered the word "inconsistency".
The prompt is (implicitly) asking to find inconsistencies ("what do you think about") within some statements of fact. Many variations of "find problems in the text" are part of its training set.

Remove the "what do you think about" and the model doesn't find inconsistencies.

Or keep it, but make the following text more consistent, and watch it continue to find inconsistencies (which don't exist).

Re:What Is ChatGPT Doing and Why Does It Work? by williamcotton on Tuesday June 18, 2024 @04:22PM (#40721842)
Re:What Is ChatGPT Doing and Why Does It Work? by hoosieree on Tuesday June 18, 2024 @08:57PM (#40723671)
"Explain" is a variation of "what do you think about", so you get similar results.

https://news.ycombinator.com/item?id=40723601

Re:What Is ChatGPT Doing and Why Does It Work? by williamcotton on Wednesday June 19, 2024 @07:20AM (#40727168)
It is most definitely not the same in any manner other than being a prompt for a response and not just a weird sentence floating in a void. What would a reasonable response be? “Cool story, bro?”