That stuck out to me too. There is a (not universally accepted) idea that language itself determines our capacity for understanding, called the Sapir-Whorf hypothesis. While it traditionally relates to humans, I've been casually working to apply it to LLMs as well.