Theory of Mind May Have Spontaneously Emerged in Large Language Models (2021)

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by kahnclusions on Saturday February 11, 2023 @06:31PM (#34757601)

That’s exactly what they are: statistical parrots. We know how they are built and how they work.

What makes them so “amazing” is just the truly massive body of human language they are trained on, which gives them the _appearance_ of intelligence or awareness. Humans communicate through language, so anything that can produce realistic-looking responses to a series of prompts in human language will appear to be “aware” to a human observer. It’s speaking our language, but don’t let yourself get sucked into the illusion.

[ Parent | on HN ]

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by int_19h on Sunday February 12, 2023 @12:01PM (#34764439)

We do not know how they work.

We know how the underlying tech works, sure. But we don't really know why, past a certain level of complexity, the "just predict the next token" trick stops feeling like a trick when you actually, you know, sit down and talk to the damn thing.

[ Parent | on HN ]