Alexa has more complex requirements (it's funny when Cleverbot gives an occasional nonsensical response, but not so funny when Alexa unexpectedly orders you a $2,000 lawn gnome - okay, still kind of funny), but I definitely agree with you. I don't think this is a challenge that requires anything close to AGI, unless you want to start having truly insightful and philosophical conversations with a computer.
> Good afternoon. Do you know any good places to get dinner?
> Mot really.
> What about dessert?
> That's if you're a good bot.
> Not for you, for me.
> Okay..
Completely useless. I asked Alexa to find me the article on hacker news from today that talks about chat bots, she said “Sorry, I don’t know that one”
As a random, unscientific test it’s not very useful yet.
It’s true that a good PA brings much earlier context, and “out of band” context to the table, but a customer support service (e.g. delta) really does not.
With this in mind, I think these conversational agents are going to be much more performant than expected in the fairly near future.