The problem is already playing out right in front of our eyes, and that’s with humans in the loop every step of the way.
And to be sure, we don't understand this question well enough that it would be safe to commit humanity to our current ideas of the best solution for all eternity.
But we are certain that we wouldn't want a future AI governor of Earth to regularly and randomly pick someone to torture to death, just because that is what human drives have led to historically.
dead internet theory - bots spamming ragebait/clickbait across social media, bots in the comments fueling more division, rage.
I think any rational person would be trying to opt out of the hyper emotional news/internet and not feed the machine, as its a little tiresome/boring to be baited so easily but that could just be bc internet natives are so used to calling out bad bait on forums
In a way, it maximizes for its survival
An AI doesn’t care if humanity destroys itself, it maximizes for views or whatever parameter it was setup with.