Re:Do Large Language Models learn world models or just surfa...
by jchmrt on Sunday January 22, 2023 @04:16AM
(#34475677)
I'm no expert in this field, but as I understand it they trained a new GPT model from scratch to play Othello. So the prompts were simply the transcript of moves that came before.
Re:Do Large Language Models learn world models or just surfa...
by Al-Khwarizmi on Sunday January 22, 2023 @04:40AM
(#34475796)
Yes, it's that. This model wasn't trained on natural language texts at all, so it can't be "prompted" with sentences like ChatGPT, etc. Lists of Othello moves is all it has seen.
It would help with reproducibility too.