News for hackers. Stuff that matters.
Re:GPT-4 performs better at Theory of Mind tests than actual... by seydor on Sunday April 30, 2023 @07:12PM (#35767414)
The fundamental concept is to learn the statistics of text, and in the process it models the syntax via long-range connections successfully. There is no indication that it actively generates "concepts" or that it knows what concepts are. In fact the model is not self-reflective at all, it cannot observe its own activation or tell me anything about it.
Re:GPT-4 performs better at Theory of Mind tests than actual... by circuit10 on Sunday April 30, 2023 @07:26PM (#35767500)
There is an indication, you can find it by clicking on this post.

The self-reflection part is probably true, but that’s not strictly necessary to understand concepts

Re:GPT-4 performs better at Theory of Mind tests than actual... by seydor on Sunday April 30, 2023 @07:32PM (#35767534)
it is important in order for us to accept it as an agent that understands things, because self-reflection is so important and obvious to us.
Re:GPT-4 performs better at Theory of Mind tests than actual... by timschmidt on Sunday April 30, 2023 @07:55PM (#35767665)
I'm still waiting for someone to prove beyond a shadow of doubt that humans have a single one of these features we're debating about the presence or absence of in LLMs.
Re:GPT-4 performs better at Theory of Mind tests than actual... by seydor on Monday May 01, 2023 @02:29AM (#35769660)
there is no way to prove because those are subjective to humans. LLMs would have to at least show they have a subjective view (currently the 'internal world' they report is inconsistent)
Re:GPT-4 performs better at Theory of Mind tests than actual... by timschmidt on Monday May 01, 2023 @04:57AM (#35770494)
The internal worlds of humans are inconsistent: https://en.wikipedia.org/wiki/Shadow_(psychology)
Re:GPT-4 performs better at Theory of Mind tests than actual... by mr_toad on Sunday April 30, 2023 @08:33PM (#35767868)
> learn the statistics

> what concepts are

How do you know concepts aren’t just statistics?

Re:GPT-4 performs better at Theory of Mind tests than actual... by seydor on Monday May 01, 2023 @02:27AM (#35769646)
"concept" is ill-defined , it s a subjective thing that humans invented. It is probably not possible to define it without a sense (a definition) of self.