Re:The Myth of AI
by indrax on Sunday November 16, 2014 @12:13AM
(#8613490)
>it apparently lacks the ability to evaluate or set its own goals.
The AI would have to evaluate the goal by some standard, so 'maximize paperclips' is a proxy for whatever goals get a high evaluation from the standard. Getting the standard right presents essentially the same problem as setting the goal.
Putting in 'a need to be intellectually satisfied by the complexity of your end product' is complicated and still wouldn't save humanity.
The AI would have to evaluate the goal by some standard, so 'maximize paperclips' is a proxy for whatever goals get a high evaluation from the standard. Getting the standard right presents essentially the same problem as setting the goal.
Putting in 'a need to be intellectually satisfied by the complexity of your end product' is complicated and still wouldn't save humanity.