Re:The impossibility of intelligence explosion
by naasking on Monday November 27, 2017 @09:09PM
(#15793658)
A superintelligence can't circumvent mathematical proof, so your scenarios are not exhaustive and safeguards are not intrinsically useless.
> but the issue here is that the author argues that there is no such thing as a general intelligence. It's all situational
An intelligence that can adapt to changing situations seems pretty general to me.
Re:The impossibility of intelligence explosion
by AstralStorm on Wednesday November 29, 2017 @03:03AM
(#15805373)
C) Intelligence explosion happens and we'll like it and it will be non threatening. Again safeguards not needed.
D) As above but it attempts to elevate is meatbags to its level.
On a separate note, does it even matter? Some people argue it's important so that we can put AI safe-guards in place, to protect mankind. But either:
A) Intelligence explosion won't happen and those safe-guards are not needed.
B) Intelligence explosion happens and the supersmart AI will easily find its way around feeble safe-guards put in place by the inferior humans.
While the end results are not the same; in either case the safe-guards are useless, though Asimov sure made a good story about them.
[1] https://arxiv.org/abs/1710.08864