Re:Do Large Language Models learn world models or just surfa...
by jchmrt on Sunday January 22, 2023 @04:16AM
(#34475677)
I'm no expert in this field, but as I understand it they trained a new GPT model from scratch to play Othello. So the prompts were simply the transcript of moves that came before.
[ Parent
| on HN ]
Re:Do Large Language Models learn world models or just surfa...
by Al-Khwarizmi on Sunday January 22, 2023 @04:40AM
(#34475796)
Yes, it's that. This model wasn't trained on natural language texts at all, so it can't be "prompted" with sentences like ChatGPT, etc. Lists of Othello moves is all it has seen.