Re:Artificial General Intelligence: Now Is the Time
by jimbokun on Monday June 04, 2007 @05:04PM
(#26330)
Skimming the article, I don't see how it's feasible to ethically engineer a "human equivalent intelligence".
The author talks about engineering a toddler level intelligence, the reasoning being that the toddler program would not be capable of figuring out a way to "escape" its box and getting into mischief that humans would be unable to control or prevent.
But the thought of "turning off" a toddler equivalent makes me queasy. Will the toddler think it is a person? What an awful, worse-than-Truman's-World-nightmare it would be for that "toddler" to find out the truth. Could we ethically "turn off" such a program?
Even if it knows that it is not human, if it is truly equivalent to a toddler it is almost certain to introduce some kind of ethical quandries we cannot possibly predict before the program actually exists. I do not see any safe way to pursue this project and successfully avoid ethical landmines.
I am also troubled by the vaguely utopian hopes this man has for his personal project. Attempts by people to implement any kind of utopian vision tend to end badly.
The author talks about engineering a toddler level intelligence, the reasoning being that the toddler program would not be capable of figuring out a way to "escape" its box and getting into mischief that humans would be unable to control or prevent.
But the thought of "turning off" a toddler equivalent makes me queasy. Will the toddler think it is a person? What an awful, worse-than-Truman's-World-nightmare it would be for that "toddler" to find out the truth. Could we ethically "turn off" such a program?
Even if it knows that it is not human, if it is truly equivalent to a toddler it is almost certain to introduce some kind of ethical quandries we cannot possibly predict before the program actually exists. I do not see any safe way to pursue this project and successfully avoid ethical landmines.
I am also troubled by the vaguely utopian hopes this man has for his personal project. Attempts by people to implement any kind of utopian vision tend to end badly.