> They suggest language models can develop world models for very simple concepts in their internal representations (layer-wise activations), such as color [9], direction [10], or track boolean states during synthetic tasks [11]
But I don’t think there have been any probes like this for ChatGPT yet
This is better evidence than the Twitter example but I bet it still wouldn’t be well received in that thread
https://thegradient.pub/othello/
> They suggest language models can develop world models for very simple concepts in their internal representations (layer-wise activations), such as color [9], direction [10], or track boolean states during synthetic tasks [11]
But I don’t think there have been any probes like this for ChatGPT yet
This is better evidence than the Twitter example but I bet it still wouldn’t be well received in that thread