Re:Paperclip Machine
by ikeboy on Sunday July 19, 2015 @11:03AM
(#9911386)
>It rests on the idea that a generally human-level of intelligence necessarily leads to a super-human explosion of intelligence.
Why must it be necessary? If there's a large chance, that's still a problem. Besides, the claim is generally that a human-created intelligence is unlikely to be in the same range as humans (because there's no reason to think that the human range on the spectrum is unique), so if it's not dumber, then it's most likely going to significantly smarter. There's also the point that if you have a human-level AI, simply throwing more computing power at it makes it strictly faster than humans.
Why must it be necessary? If there's a large chance, that's still a problem. Besides, the claim is generally that a human-created intelligence is unlikely to be in the same range as humans (because there's no reason to think that the human range on the spectrum is unique), so if it's not dumber, then it's most likely going to significantly smarter. There's also the point that if you have a human-level AI, simply throwing more computing power at it makes it strictly faster than humans.
See http://intelligenceexplosion.com/en/2011/plenty-of-room-abov... and http://www.nickbostrom.com/superintelligence.html for some examples of these arguments.