I don't think anyone who has actually used GPT-4 for more than a few minutes ever believed this. It was just a trendy thing to say for a while.
I think it's more about the uniqueness of human intelligence. If you see it as a hard line that defines humans as distinct from other things, then similar behavior that is exhibited by things that are "not supposed to" have anything like it has to be explained away, somehow. Hence the Chinese room argument etc.
it does not evidence an ability to "reason" in the deliberate, self-reflective sense we are familiar with
it is still an open question whether language models are capable of careful, creative reasoning, or researching and arranging an extended argument
I would not be too surprised if future models could do this, but until that day, we do ourselves no favors overstating their abilities- and the less we personify them the better imho
This is strikingly clear evidence that it is capable of logical reasoning and "knows things", and puts to rest repeated claims that it is just memorization and collaging. You can't memorize every combo of two 13 digit numbers within the file size of the model.