Kind of taking this a step further, what is the worst thing that an AI run amok could do to existentially threaten the human race? I feel like almost anything could be short-circuited by some form of "pulling the plug" before it got too far. But, hypothetically, if it were possible to launch nukes without human intervention, or with maybe a small amount that could be socially engineered, that seems plausible.
So, what if, along the lines of MAD doctrine and the plot of Battlestar Galactica, the best thing we could do for AI safety is just to engineer our other systems so that a hypothetical superhuman adversary could not use them against us? (This doesn't really solve AI child porn and fake news but those things are mostly just imaginative reflections of the people using them and you can't really fix that)
Probably convincing humans that untrue things are true. Think less "AI launches nukes" and more "AI convinces people in country A that country B is trying to subvert & destroy them, while it does the same for country B wrt A."
Has the internet enabled more people to be more educated and informed, or has it enabled echo chambers of misinformation? I don't think it's demonstrable that it's not a wash. Technology is an extension, a mirror...we need to fix ourselves, AI is not the problem.
I strongly disagree with the opinion that it has been a net negative.
Lies and misinformation, or choosing chatbots over therapy and relationships might sound scary, but as of now I see practically negligible impact there. Even social media is still roughly as usable as before AI.
Important safety features ("do not generate child porn", "statements should be factual or backed by evidence") were simply not part of the design of these systems and have yet to truly solved to this day, but AI companies decided to release these technologies onto the general public regardless of their glaring flaws.
I like AI for its shitposting capabilities and its neat parlour tricks, but I also believe so far it has been a net negative for everyone but the richest minority of society who benefits from firing people and having computers do half their jobs badly. It's too late now, but in hindsight I do agree that these systems were too dangerous to release in this shape.