Re:GPT-3 has no idea what it’s talking about
by mannykannot on Saturday August 22, 2020 @08:58PM
(#24248638)
> GPT3 correctly grasps that there is a hidden context to this weird prompt.
That is interesting. How does it indicate its understanding that there is a hidden context?
There can be no such thing as a bad prompt from gpt3's perspective. A bad prompt is one where the user has a specific purpose which is not expressed. It's bad because you know beforehand that gpt3 can not align with it.
Someone pours grape juice into a bottle and becomes worried that is not safe to drink. GPT3 correctly grasps that there is a hidden context to this weird prompt, however when given no other information it guesses that this hidden context is something known only to the hypothetical character in the prompt. I would probably do this too.
When you give it the correct context (this weird prompt is a logic test) then it gives you the answer you expected.