Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ...
by hammyhavoc on Tuesday May 16, 2023 @02:39PM
(#35965883)
ChatGPT itself tells me it has no explicit world model.
[ Parent
| on HN ]
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ...
by NumberWangMan on Tuesday May 16, 2023 @02:51PM
(#35966026)
I mean, just like you can create 1-line python script that claims "I am an AGI" and have that fact be false, you can have ChatGPT tell you it has no explicit world model, while exhibiting behaviors that can only really be explained by it having some sort of model of the world inside it.
Fine-tuning is like a PR agent teaching someone what sorts of things not to mention on TV even though they may be true.
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ...
by hammyhavoc on Tuesday May 16, 2023 @03:02PM
(#35966176)
What are some of these behaviours?
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ...
by NumberWangMan on Tuesday May 16, 2023 @04:40PM
(#35967461)
Patrickas responded with some examples: https://news.ycombinator.com/item?id=35966307
Re:US Senator Uses ChatGPT for Opening Remarks at a Hearing ...
by patrickas on Tuesday May 16, 2023 @03:13PM
(#35966307)
It is not about what the model tells you.
This paper shows an emergent world model in an LLM that was taught to play otello moves https://ar5iv.labs.arxiv.org/html/2210.13382
https://arxiv.org/pdf/2303.12712.pdf This paper discusses (among other things) how a GPT4 model navigated between rooms in a text adventure game and was able to create a map afterward. Literally building a model of the world as it was navigating and drawing a map of that afterwards