> So AI is taking over the world, and we should just accept that it has severe limitations of just parroting the training data like a Markov chain? This is the algorithm we think can solve everything?

"No", to both questions.

These systems are a work-in-progress, constantly improving. They have value, even though they are far from perfect.