I had an interesting experience with an AI support call a few days ago (not with Amazon). The LLM was being unhelpful and completely failing to understand what my problem was. Eventually, I resorted to just repeating "I want to talk to a human", which would result in a response like (paraphrasing) "I understand that you want to speak with a human, but tough.".

Eventually I lost patience completely and said "I just want to talk to a fucking human". At which point the AI's speaking tone changed completely and became very curt.

It didn't get me the needed support (I never got support and will no longer do any business with that company), but I found it pretty hilarious.

Ten years or so ago the first phone trees with speech recognition were generally trained to recognize profanity and transfer the call to a human. I got great results, for a while, by opening every call with a string of expletives. That trick's mostly stopped working, but I still try sometimes, just for fun.

Because what you call AI is not intelligent. Imagine if it starts to hallucinate that to solve your problem it needs to delete your account, and it has the power to do so.