I think they are, just not in the way they think. They summon huge complex systems that nobody grasps and fail in weird unexpected statistical ways.
Stupid software bugs were always the thing that's gonna bring doom. Just thought it was that guy that believes to be a genius and never makes mistakes instead of some computer hallucinating.
Stupid software bugs only bring doom if you are overly reliant on stupid software. We're morons for putting critical infrastructure on the internet.
In related news, I just came across the headline,
US and Russia to oppose talks on limiting autonomous weapons
https://www.reuters.com/world/us-russia-oppose-talks-limitin...
What does worry me a bit is that the people running these AI companies _think_ they're summoning some earth-shattering angel of death, but they are so self-righteous (literally) that they think it's actually good that they're doing this.