News for hackers. Stuff that matters.
Re:Elon Musk, Stephen Hawking and fearing the machine by joe_the_user on Monday June 23, 2014 @12:08PM (#7932697)
"If we're talking about bad AI, shouldn't we ask why it would want to kill us?"

I think the folks mentioned in the article were talking about the broad threads posed by AI. I agree we have little basis besides movies for autonomous AI just deciding to attack for no reason or for human-equivalent reasons. But we have every reason to think that neutral AI, AI that still follows orders, could be used by humans to continue all the conflicts that they already pursue with horrific consequences.

The other thing is, it's hard to imagine something qualifying as AI without it understanding things like ethics

Depends what you mean by "understand". Many highly intelligent humans acts unethically but even more highly intelligent humans have gleefully followed unethical orders given them by their superiors. Consider you'd be designing your mind rather than just finding it after millions of years of social evolution, it seems like you could create an intelligent mind quite capable of following orders nearly blindly.

If anything, the whole "it might go insane and kill us" schema is implausible enough to detract from the immediately obvious danger - "it might sanely follow the insane orders of humans in the fashion that human society has seen over and over again but this time with superhuman power".

Re:Elon Musk, Stephen Hawking and fearing the machine by dragonwriter on Monday June 23, 2014 @01:14PM (#7933101)
> I agree we have little basis besides movies for autonomous AI just deciding to attack for no reason or for human-equivalent reasons.

Of the very many species that have become extinct as a result of human action, how many were the result of a deliberate attempt by humans to eradicate the species? Very few.

The others are, however, still just as extinct. AI doesn't have to "decide to attack us" to be a danger.

Re:Elon Musk, Stephen Hawking and fearing the machine by jacquesm on Monday June 23, 2014 @01:06PM (#7933057)
> I agree we have little basis besides movies for autonomous AI just deciding to attack for no reason or for human-equivalent reasons.

And a 100 years or so of SF literature that served as the basis for some of those movies.