Re:Elon Musk, Stephen Hawking and fearing the machine
by capisce on Thursday July 03, 2014 @05:43AM
(#7982207)
Even if you imagine just a small risk of an AI being hostile or indifferent toward us, is it worth gambling our future on that risk? Where is your evidence that a vastly greater intelligence would have a moral that is perfectly aligned with ours, unless we programmed it perfectly for that purpose and made sure any self-modification by the AI preserved those moral invariants?
http://kajsotala.fi/2007/10/14-objections-against-aifriendly...
If you imagine that your children will be evil and kill you you have damned them before they have even been born. Not only that but the analogy sucks even more because in this case there isn't even the excuse that we don't understand how biology leads to behavior because we will have build the systems ourselves.