I predict the next super weapon will be an AI that generates content so captivating, that it acquires everyone’s attention, and/or induces unhealthy biological response.

Proof of attack vector:

https://www.thegamer.com/15-people-who-have-died-playing-vid...

Imagine, for example, a content generator whose reward function is heart rate.