Re:Elon Musk donates $10M to keep AI beneficial
by eli_gottlieb on Thursday January 15, 2015 @12:23PM
(#8893814)
> Is there any sure way to stop the super intelligent AI from changing its own inherent values though?
Yes: give it inherent values.
>I guess a problem with containment is that unless it's mathematically proven to be impervious,
AGI, when it eventually exists, must run according to the basic laws of learning. If you don't give it evidence that's more likely in possible-worlds with an external world than without one, it won't posit an external world.
Stopping that information leak isn't that hard, provided you have full control over the agent-environment surface in the first place. It does, however, make your "agent" completely useless for anything beyond playing Atari games.
Yes: give it inherent values.
>I guess a problem with containment is that unless it's mathematically proven to be impervious,
AGI, when it eventually exists, must run according to the basic laws of learning. If you don't give it evidence that's more likely in possible-worlds with an external world than without one, it won't posit an external world.
Stopping that information leak isn't that hard, provided you have full control over the agent-environment surface in the first place. It does, however, make your "agent" completely useless for anything beyond playing Atari games.