Re:ChatGPT: It has no inner monologue or meta-cognition
by chownie on Tuesday May 02, 2023 @08:06AM
(#35786227)
I just managed to get a hallucination within 30 seconds.
"Give me some YouTube creators who focus on tutorials for the Godot game engine"
It returns a list of 7 creators, one of the creators it provides in the list doesn't exist.
"Provide a link to a video by one of these creators"
This works, the URL is right but the content is slightly different to what it describes (ChatGPT reports that the tutorial is for a platformer but it's general 2d advice)
"Now provide a link to similar material but for a 3d game"
Provided link doesn't exist, creator doesn't exist. Entirely hallucinated.
Even better, following up with "Is that URL right?" gets this response:
> I apologize, it seems I made a mistake in my previous response. The video link I provided by HeartBeast is actually a tutorial for creating a 2D platformer in Godot, not a 3D first-person shooter.
and then another hallucinated link. Important to note, HeartBeast is a real creator but that wasn't the creator it listed originally and that creator has not made any first person tutorials. ChatGPT hallucinated with very little effort, then hallucinated a mistake, then hallucinated the solution.
"Give me some YouTube creators who focus on tutorials for the Godot game engine"
It returns a list of 7 creators, one of the creators it provides in the list doesn't exist.
"Provide a link to a video by one of these creators"
This works, the URL is right but the content is slightly different to what it describes (ChatGPT reports that the tutorial is for a platformer but it's general 2d advice)
"Now provide a link to similar material but for a 3d game"
Provided link doesn't exist, creator doesn't exist. Entirely hallucinated.
Even better, following up with "Is that URL right?" gets this response:
> I apologize, it seems I made a mistake in my previous response. The video link I provided by HeartBeast is actually a tutorial for creating a 2D platformer in Godot, not a 3D first-person shooter.
and then another hallucinated link. Important to note, HeartBeast is a real creator but that wasn't the creator it listed originally and that creator has not made any first person tutorials. ChatGPT hallucinated with very little effort, then hallucinated a mistake, then hallucinated the solution.