> I'm a daily user of the most recent Claude and while it's amazing at presenting other people's knowledge and reducing cognitive load.
'Presenting other people's knowledge' is enough to get the job done when that knowledge encompasses the entire internet.
My experience is that it's really darn good at producing text, but it's not a logic engine - it's not designed to be one and even the most recent versions make mistakes which indicate it's not actually thinking.
It is, by definition, design and architecture a system that produces believable text.
Here's a task to give it which pulls the veil right off:
Ask it to add tests to a piece of code where code coverage is 100%, but it doesn't actually test functionality 100%. You'll start seeing nonsense sooner or later.
The “just a text predictor” framing was fair a couple years ago but hasn’t kept up. Current models can genuinely identify untested edge cases even when coverage is 100%. You're definitely using the latest and greatest models?
The architecture started as next-token prediction, sure, and yes, human judgment is still required, but that judgment is being captured and integrated too. Every time millions of people use these models, their feedback feeds the next round of improvements.
Also, these models don’t need to replace your best engineers to be disruptive. They just need to outcompete the bottom of the bell curve. For a lot of junior-level work, we’re already getting close.
Claude 4.6 opus high, specifically.
As for human brains: every self respecting neural networks 101 course is prefaced with "don't draw analogues to the human brain". And for good reason. Natural neural networks are fundamentally way more complex at every scale.
Also the brain indeed predicts, but also verifies and learns from the predictions. LLMs don't do that - not in real time at least.
Due to a text predictor?
I'm a daily user of the most recent Claude and while it's amazing at presenting other people's knowledge and reducing cognitive load by filling in the gaps, it's still just a machine that predicts text and that is a limitation which won't be overcome in this generation of such tools which, including research demonstrations, are close to a decade old already.
To me the main issue is that investors are not aware of these limitations and will keep pouring money into this way beyond everyone's breaking point. But really that's a failing of the world's economic system, which relies too much on their whims.