News for hackers. Stuff that matters.
Re:Teaching ChatGPT to Speak My Son’s Invented Language by vintermann on Tuesday April 11, 2023 @03:25AM (#35521933)
The Bing LM, or rather the service, did have "inner monologue" in the sense of text that it would generate, but not show to the user, and treat as "thoughts" to guide the generation of an actual reply that the user would see.

We know this because it happily told us, including the json format it uses internally.

Re:Teaching ChatGPT to Speak My Son’s Invented Language by Vespasian on Tuesday April 11, 2023 @03:38AM (#35522028)
Interesting. I didn't know that.

When using gpt-4 directly through the API we can emulate this behavior

Re:Teaching ChatGPT to Speak My Son’s Invented Language by beepbooptheory on Tuesday April 11, 2023 @06:21AM (#35523082)
And you trust what it told you?
Re:Teaching ChatGPT to Speak My Son’s Invented Language by vintermann on Tuesday April 11, 2023 @06:57AM (#35523342)
Yup, for the same reason I trust e.g. jailbreaks exposing the prompt: it was consistent.

Really, just asking again is a fine way to expose all sorts of "hallucinations" in a LM.

Re:Teaching ChatGPT to Speak My Son’s Invented Language by int_19h on Tuesday April 11, 2023 @07:02PM (#35532883)
No, but the reconstructed examples have "im_start" and "im_end", which strongly implies that it is, if not verbatim, then a close enough restatement of the real deal. Take a look:

https://www.make-safe-ai.com/is-bing-chat-safe/Prompts_Conve...