News for hackers. Stuff that matters.

A comment on Superintelligence: The Idea That Eats Smart People. Parent comment

Re:Superintelligence: The Idea That Eats Smart People by lmm on Friday December 23, 2016 @08:27AM (#13244590)
> Semi-related, if you made a giant brainlike calculator out of water pipes and valves and shit, and asked it a question, then turned all its pipes and valves for a while... it would probably just say "please kill me."

Um why? Most humans don't do that.

[ Parent | on HN ]
Re:Superintelligence: The Idea That Eats Smart People by SerLava on Friday December 23, 2016 @12:56PM (#13246126)
Well it would kind of be a brain trapped in sensory deprived hell.

The point is I think people would expect pretty mundane things from a giant "mechanical" brain, but as described, it would be very unpredictable and complex. It would do things that instantly make the experimenters uneasy.

[ Parent | on HN ]