As long as our minds pops out appropriate thoughts for the given context we don’t even think about the magic machinery behind the scenes that did that.

When queried about our thinking we are mostly creating a plausible story, not actually examining our own thinking.

Also, blind people can talk sensibly about many visual phenomena, having learned about them through language

I think the new LLM are giving us all so many wow’s, because “understanding” is the only kind of compression that actually works at the scale of the training data

I.e. representations are being created that reflect the actual functional, as well as associative or correlative, relations between concepts.