is it skin deep though?
Well it's certainly fragile and easily lost.
Are you implying some deeper understanding in GPT3?
I agree it's fragile and dreamlike - but it is in my opinion genuine understanding. If you have or ever do have children you can observe them pass through a similar kind of stage, fractured incomplete understanding, dreamlike, yet still understanding. It crystallises slowly overtime. I predict the same will happen as we expand the models and add more complexity.
What I find most impressive is just how much of it's output appears to make sense.
Of course "make sense" is the critical part of this. It's skin deep - but still quite astonishing fairly frequently.