Whenever I see discussions about the dangers of AI, they are always about those Terminator-like AI-overlords that will destroy us all. Or that humans will be made redundant because robots will take all our jobs. But there are never concrete arguments or scenarios, just vague expressions of fear. Honestly, if I think about all the things HUMANS have done to each other and the planet, I can hardly imagine anything worse than us.
It seems that their concerns are always dismissed based on the current state of the art, which is short sighted to say the least.
Universe full of computronium, solving Collatz conjecture?
Make no mistake, FUD kills. If you're in a position of influence, you want to make goddamned sure you're right before you hold back human (and machine) progress by focusing only on Things That Could Go Horribly Wrong. Otherwise, you're basically asking for unintended consequences instead of just trying to warn humanity about them.
Musk has actively been trying to incite governmental regulation, for instance: https://www.recode.net/2017/7/15/15976744/elon-musk-artifici...
... which is just outrageously inappropriate at this stage. If he goes full Howard Hughes, which I'm increasingly worried about, he could set us back decades.
A) We're striving to make strong AI.
B) It seems plausible that as computing and AI research continues, we'll get to strong AI eventually given that brains are "just" extremely complex computers.
C) We do not know what strong AI will be able to do or how it will act, if it exceeds human intelligence.
The concern is not with the current state of the art, but what could happen in the future if we continue improving AI without seriously considering some safeguards against making a system that at some point becomes clever enough to start making itself even smarter.
I won't claim I'm an AI expert, but I think people like Musk and Hawkins deserve (based on their accomplishments) to be taken serious when they express concerns. I very much doubt that everyone in this thread dismissing their comments as irrational fear mongering have enough knowledge on the topic to do so.