Re:Elon Musk, Stephen Hawking and fearing the machine
by mercer on Monday June 23, 2014 @04:27PM
(#7934416)
Is it not plausible that an AI modeled after humans is also likely to have human-like flaws such as the desire to conquer? The better we get at creating complex, human-like AI, the bigger the likelihood of unintended side-effects (leaving aside whether this is feasible in the first place, of course).
The absurdity of simultaneously fathoming the eventual death of the universe and also caring about accomplishing things and making decisions and living the particulars of one's life is uniquely human. We all know we're going to die, but we still spend lots of effort deciding about pizza toppings. (See Thomas Nagel's The Absurd).
Why would an AI care to do anything we didn't tell it to care about? There's no inherent link between being sentient and having the same psychological priorities as humans. We're irrational, and I don't think they will be.