News for hackers. Stuff that matters.
Re:Do Large Language Models learn world models or just surfa... by jchmrt on Sunday January 22, 2023 @04:16AM (#34475677)
I'm no expert in this field, but as I understand it they trained a new GPT model from scratch to play Othello. So the prompts were simply the transcript of moves that came before.
Re:Do Large Language Models learn world models or just surfa... by Al-Khwarizmi on Sunday January 22, 2023 @04:40AM (#34475796)
Yes, it's that. This model wasn't trained on natural language texts at all, so it can't be "prompted" with sentences like ChatGPT, etc. Lists of Othello moves is all it has seen.