Re:On the left is GPT-3.5. On the right is GPT-4
by jacknews on Sunday March 19, 2023 @04:10AM
(#35216996)
He seems completely dismissive, and rather certain that GPT doesn't have a 'world model', despite IMHO not really having enough of an understanding (since no-one does, really), to justify that certainty.
GPT has been trained on text, and so any 'world model' is going to be a step removed from the world, compared to systems that have been trained on real-world stimulii (vision, sound, touch) like animals and humans.
But that does not mean it doesn't have a 'world model' at all, just that it's models are not going to be something we immediately recognize.
GPT has been trained on text, and so any 'world model' is going to be a step removed from the world, compared to systems that have been trained on real-world stimulii (vision, sound, touch) like animals and humans.
But that does not mean it doesn't have a 'world model' at all, just that it's models are not going to be something we immediately recognize.