Re:Do Large Language Models learn world models or just surfa...
by mountainriver on Sunday January 22, 2023 @11:32AM
(#34479031)
I don’t think we’ve seen any evidence of experimentation in these models, it is in fact the key component they are missing
[ Parent
| on HN ]
Re:Do Large Language Models learn world models or just surfa...
by naasking on Sunday January 22, 2023 @12:04PM
(#34479465)
Sure, but my point is simply that evidence of mistakes does not entail a lack of an accurate world model. When underlying models can only be inferred, there can never be 100% certainty of any inferred model. Humans are only certain of Othello's rules because we have direct access to those rules.
If you put a human being in GPT's place in this exact same scenario, they too would make comparable mistakes. Humans are clearly capable of world models, therefore those mistakes are not an indication that world models are not in use.