News for hackers. Stuff that matters.
Re:GPTs and Hallucination by ctoth on Tuesday September 10, 2024 @01:45PM (#41503508)
I believe they used the game to show how the same underlying technology would build a mental model not because the game was perfect-information, but because it was easy to probe for without a lot of other unrelated concepts getting in the way.

Perhaps this is what you're looking for (similar technique, larger model?) https://www.anthropic.com/news/golden-gate-claude

> In the “mind” of Claude, we found millions of concepts that activate when the model reads relevant text or sees relevant images, which we call “features”.

> One of those was the concept of the Golden Gate Bridge. We found that there’s a specific combination of neurons in Claude’s neural network that activates when it encounters a mention (or a picture) of this most famous San Francisco landmark.

Sounds like a mental model to me! An internal representation of an external concept which exists in the real world.

There are no comments on this comment yet.