> For a start, GPT-4 doesn't include in its generation the current state of its internal knowledge used so far
Sure. But are you certain that you NEED write access to long term memory to think? Would your thinking capabilities degrade meaningfully if that was taken away?
Re:Simply explained: How does GPT work?
by TuringTest on Friday April 07, 2023 @04:17PM
(#35486453)
Yes, I would say that a brain without the capacity to form new memories has degraded thinking capabilities.
For a start, GPT-4 doesn't include in its generation the current state of its internal knowledge used so far; any text built can only use at most the few words already generated in the current session as a kind of short-term memory.
Biological brains OTOH have a rhythm with feedback mechanisms which adapt to the situation where they're doing the thinking.