Very insightful! I agree that the models on their own may truly be simulating awareness of certain concepts, and not "directly" modeling them. It's hard to know, but these kinds of experiments do make it clear that there are profound limits to the current systems. For instance, even if they are superhuman polyglot poets they may not have any model of "time" (ironically, the most commonly used word in many languages).