My guess is that you can find 99% of Maya pyramids in a Lidar set in a fairly short time with a traditional neural network, but you might find the last few using a network of AI agents, because they are capable of "creative" problem solving and using different methods/parameters/tools over several iterations.
You train a cat-classifier, and they will fail for a plush cat. Or maybe fail the other way, but not realizing it should also report a plush cat.
LLMs are much more robust, "find only the real cats in this picture" or "find all cats, including artificial/drawings/..."
And yes, you can add more training data to your classifier, but it's a never ending battle.
With LLM you unlock a whole new world of possibilities regarding the speed and result but we are also finding ourselves in a position where "asking the LLM" because the cheat for everything, no reason to dig further
It is becoming a boring homogenous world where we are trading deep expertise with being able to query the magic box