That is a completely different issue, though. We were not talking about the usefulness of the models' behavior, but rather of its fundamental nature. Right now I wouldn't trust an LLM for anything where the result is not either for entertainment purposes or undergoes human vetting. But I also don't trust many humans, and for reasons that are fundamentally the same - you implicitly acknowledged it by talking about "well-developed human intellect". And I would still trust a random human more than GPT-4 - but, again, this has more to do with its ability to reason being inherently limited (by model size, context size etc), not because it's originally trained to predict tokens.