Even if we just talked about large-scale high-performance statistical data processing, or "algorithmic automation" (AA) it would still be used everywhere, it would just be more difficult for laypeople to come to grips with it.
It's a bit as if people around 2000 were saying it's stupid to talk about "cyberspace", it's not some new space out there, it's just people sitting behind their computers connected by wires! But that term was not the reason for the hype.
Now, sure the label AI does contribute its share to the hype, but this stuff is so good that whatever way you call it (as long as it's not too many syllables), it will become a buzzword just for that reason. It's like euphemism treadmills. You can rename the concept, but it will re-acquire the same meanings. I mean "convolutional" managed to become quite a buzzword itself (even though it's a well defined technical term), as it appeared so often alongside really sexy stories.
The damage done is obvious. We discount human agency and human labor in the face of this idea. Products are being sold based on this idea. Foreign and domestic policy, security and privacy, and private and public funding are being redirected by this idea.
If one were to simply replace "AI" with "machine learning", which is the name of the actual technology in most of these cases, in most of these contexts the hype and ideology would go away. And with it take away the attention and the money. We would then be able to focus on better things.