That's basically the conclusion Wolfram made in this excessively long article [0] he wrote (which is nonetheless worth a read):
> The specific engineering of ChatGPT has made it quite compelling. But ultimately (at least until it can use outside tools) ChatGPT is “merely” pulling out some “coherent thread of text” from the “statistics of conventional wisdom” that it’s accumulated. But it’s amazing how human-like the results are. And as I’ve discussed, this suggests something that’s at least scientifically very important: that human language (and the patterns of thinking behind it) are somehow simpler and more “law like” in their structure than we thought. ChatGPT has implicitly discovered it. But we can potentially explicitly expose it, with semantic grammar, computational language, etc.
[0] https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...
So A is the same as B just as much as A is the same as C, because A, B, and C are just words with no meaning to ChatGPT.
ChatGPT seems like the endpoint of certain lines of poststructuralist philosophy. There is no meaning to the text, only words. Words relate to other words, and that is all.