Language models can explain neurons in language models

Re:Language models can explain neurons in language models by YawningAngel on Wednesday May 10, 2023 @08:10AM (#35886203)

That's possible I guess but is there positive evidence for that being the case?

[ Parent | on HN ]

Re:Language models can explain neurons in language models by TeMPOraL on Wednesday May 10, 2023 @08:40AM (#35886469)

The way I phrased it isn't exactly structured to admit any kind of evidence, so let me destructure it. My observation is that:

- The argument that LLMs are missing introspection / inner voice is based on attempting to compare LLMs directly with human minds.

- Human minds have conscious and unconscious parts; for many people, part of the boundary between unconscious and conscious mind manifests as the "inner voice" - the one that makes verbalized thoughts "appear" in their head (or rather perhaps become consciously observed).

- Based entirely on my own experience in using GPT-3.5 and GPT-4, and my own introspection, I feel that GPT-4 bears a lot of resemblance to my inner voice in terms of functioning.

- Therefore I propose that comparing LLMs directly to human minds is unproductive, and it's much more interesting/useful to compare them to the inner voice in human minds: the part of the boundary between unconscious and conscious that uses natural language for I/O.

[ Parent | on HN ]