News for hackers. Stuff that matters.

A comment on Theory of Mind May Have Spontaneously Emerged in Large Language Models (2021). Parent comment

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by mdp2021 on Saturday February 11, 2023 @05:41PM (#34757169)
Radically «unlike», since the main activity of the intelligent entity is verification.
[ Parent | on HN ]
Re:Theory of Mind May Have Spontaneously Emerged in Large La... by wvoch235 on Saturday February 11, 2023 @06:08PM (#34757384)
Either this is a missing layer, and we’ll get there soon, or one could say verification is happening through the statistical model. We need to see if we can train hallucinations out by having it rely on a stable data store to retrieve facts rather than trying to pull facts from the model itself. This is still similar to how the brain has discrete components for memory storage and retrieval.
[ Parent | on HN ]
Re:Theory of Mind May Have Spontaneously Emerged in Large La... by webmaven on Saturday February 11, 2023 @06:21PM (#34757501)
> This is still similar to how the brain has discrete components for memory storage and retrieval.

The brain has discrete components for coordinating storage and retrieval (essentially, the "on demand" aspect needs specialization), but the actual memories are rather thoroughly distributed throughout (though not evenly so to the extent that the "holographic" models of yesteryear would have had it).

[ Parent | on HN ]
Re:Theory of Mind May Have Spontaneously Emerged in Large La... by mdp2021 on Saturday February 11, 2023 @06:18PM (#34757467)
> we’ll get there soon

Hopefully - but that would be the absolutely critical part.

> stable data store to retrieve facts rather than trying to pull facts from the model itself

This is not clear: intelligence is a process of refinement of a world model.

[ Parent | on HN ]