"keep in mind that Eliezer Yudowsky is but a human (though a very smart one), yet he did got out of the box"
Not quite sure what this means. Any references?
Re:Predicting the Future of Computing
by loup-vaillant on Wednesday December 07, 2011 @09:21AM
(#3323847)
Edit: you're right, I'm not clear. An experiment was made, in which Eliezer and some other person talked during 2 hours on IRC. Eliezer played the AI, and the other played the Guardian. The AI is supposed to convince the Guardian to "let it out" by the end of those 2 hours. No word play or such, the Gardian has to make a concious decision for the AI to win. The result is to be acknowledged publicly by PGP signed e-mail by the losing party. Eliezer won twice, over people who publicly stated that there was no way an AI would convinced them. Even though they could just say no, they didn't, and later sent the e-mail acknowledging they let the AI out.
Relevant links:
http://yudkowsky.net/singularity/aibox
http://en.wikipedia.org/wiki/AI_box http://rationalwiki.org/wiki/AI-box_experiment
Basically, all the AI needs is a text terminal interface. From then it will almost certainly convince an operator to let it out and take over vulnerable computers on the internet. Then it will have much more humans at its disposal to do its bidding.
Even if you're not as certain as I am, keep in mind that Eliezer Yudowsky is but a human (though a very smart one), yet he did got out of the box. I find hard to imagine that anything smarter than him couldn't do the same.