ETA:
I should point out that it doesn't just "smoosh google results together", and it can actually do pretty interesting transformations beyond a simple "Grabbing the first result". If I ask ChatGPT to give me ten unique Java homework assignment problems, it will give me exactly that, and from my experience they actually are unique, at least they don't show up immediately when I search for similar things on Google. I can then ask it to give me those questions in LaTeX so that I can render it into a pretty thing. I guess you could argue that that is just an AST, so fair enough, but I think it's pretty easy to see why people are losing their shit over it.
It also has for more than a year hooked into Wolfram Alpha, so it addition to usually correctly parsing your problem, it can then send that parsed problem to a more objective source and get a correct answer.
ChatGPT has been an immense timesaver for me. It's been great to generate stuff like homework assignments, or to summarize long text into something more palatable. I don't automatically trust its output obviously, but it's considerably more useful than a Markov chain.
And I agree that there is certainly a capacity for reasoning, no matter how flawed it is. There is plenty of evidence of AI solving novel problems 0-shot. Maybe not 100% of the time, but even if you have to run it 100 times and it gets it right 75% of the time in pure reasoning problems, it's doing better than randomness.
It doesn't have to be "magic" to displace a lot of things people spend time on every day.
Asking AI to do anything that requires "I" has it falling flat on its face in a cruel mockery of the word "I" and I just don't understand the hype. Well, that's a lie I do understand the hype and the mechanism by which piles of cash and gigawatthours of energy are being burned through and it makes me sad.
When all of the upcoming virtual brand ambassadors prove to be embarrassing failures maybe a splinter of reality will penetrate the hype-reinforced skulls of all of the "visionaries" funding this nonsense.