News for hackers. Stuff that matters.
Re:ChatGPT: It has no inner monologue or meta-cognition by mg on Tuesday May 02, 2023 @05:26AM (#35785119)
Tried them. None worked.

Did you hallucinate these?

Re:ChatGPT: It has no inner monologue or meta-cognition by chownie on Tuesday May 02, 2023 @08:06AM (#35786227)
I just managed to get a hallucination within 30 seconds.

"Give me some YouTube creators who focus on tutorials for the Godot game engine"

It returns a list of 7 creators, one of the creators it provides in the list doesn't exist.

"Provide a link to a video by one of these creators"

This works, the URL is right but the content is slightly different to what it describes (ChatGPT reports that the tutorial is for a platformer but it's general 2d advice)

"Now provide a link to similar material but for a 3d game"

Provided link doesn't exist, creator doesn't exist. Entirely hallucinated.

Even better, following up with "Is that URL right?" gets this response:

> I apologize, it seems I made a mistake in my previous response. The video link I provided by HeartBeast is actually a tutorial for creating a 2D platformer in Godot, not a 3D first-person shooter.

and then another hallucinated link. Important to note, HeartBeast is a real creator but that wasn't the creator it listed originally and that creator has not made any first person tutorials. ChatGPT hallucinated with very little effort, then hallucinated a mistake, then hallucinated the solution.

Re:ChatGPT: It has no inner monologue or meta-cognition by ars on Tuesday May 02, 2023 @01:52PM (#35791535)
Wow, they've improved it. I have in my history log a question like this from March with an entirely hallucinated reply.

I tried it again today because of your reply, and it tells me "it can't find such a book". That's pretty impressive they've improved that.

So I tried this instead: "give me some sources for studies on the effect of air pollution on fertility"

It gave me 5 sources, every single one hallucinated.