Fair point. I'm not sure if LLMs like GPT-4 haven't passed that test, but you're right about that particular distinction.

I think the larger point, that we don't have very reliable tests for these things, as we're finding out with the testing results that GPT-4 has been showing, is still valid; leading us to have difficulty telling whether GPT-4 is actually intelligent or if it is coming to its intelligent through other means. I think in that way the distinctions are the same.