We contact support services to fix material problems. 'This booking is wrong.' 'I want a refund for that.' AI systems aren't empowered to solve these problems. At best they can provide information. If the answer is information - the user can likely already find it online themselves (often from a better AI model than they're going to find running your support line). If they're calling, they most often want something done.
As we argue on the orange site, companies are paying Sierra AI to integrate voice and text agents into their systems to look up account information and process refunds. Fallbacks to human agents are built in to these systems.
We all hate phone trees because they never have the capability to handle exceptions to the most basic functions. We shout "speak to an agent!" into the phone because their website and phone trees only handle the happy path.
So customer support needs to know how the systems works and need to understand what the data means, but also has to know when the system is factually incorrect. Customer support has to know when the second party is speaking the truth.
This is cited so often. We tried it at a large scale with some of the best engineering talent but unfortunately the humans on the other side preferred speaking to and interacting with a human by a wide margin.
We are still trying with the latest AI models but humans are still doing better at serving other humans.
In one of our studies, we observed by a large margin that our customers would hang up immediately on knowing that they are interacting with an AI system.
I have heard this from others as well.