News for hackers. Stuff that matters.
Re:Is Intelligence Self-Limiting? by jimrandomh on Saturday March 10, 2012 @12:14PM (#3688138)
This is called "wireheading", and while it's an interesting possibility, unfortunately what we know indicates that AIs won't do it. See Stephen Omohundro, "The Basic AI Drives" (http://selfawaresystems.files.wordpress.com/2008/01/ai_drive...). The basic argument is that a sufficiently intelligent mind will make a distinction between the world being a certain way, and it perceiving that the world is a certain way, and that its goals will be defined in terms of the former; and since misperceiving the world impairs its ability to influence it, it will protect its perceptions from corruption.
Re:Is Intelligence Self-Limiting? by watmough on Sunday March 11, 2012 @11:05AM (#3690454)
Louis Wu's tasp in Ringworld also comes to mind.