News for hackers. Stuff that matters.
Re:Andrew Ng: Why 'Deep Learning' Is a Mandate for Humans, N... by Jach on Tuesday May 05, 2015 @03:48PM (#9494521)
If you have no idea what the superintelligence will do, then you should set your expectation to be the outcome of any random one of possible superintelligent mind designs. Not all superintelligent mind designs are totally unpredictable -- if I know it will prefer winning in a game of chess to losing, I predict it will win every match against a human, even if I don't know exactly what moves it will make. If I know it will prefer existing to not existing, I predict it will seek the resources to continue existing. If the superintelligence has the hardwired goal of producing paperclips, one of the possible outcomes is tiling the solar system with paperclips. Another is that humans succeed in shutting it down but not until after it's killed people.

Once you're done enumerating as many possibilities as you can for what a superintelligence might have as its goals, simple and complicated or even nonexistent, and what the various outcomes of a superintelligent agent with those goals broadly look like, find out how many of them are positive, negative, or neutral to the future of humanity, especially if these things the superintelligence does requires resources humans also use. I did this once, it convinced me that the likely case is something negative for humanity, even if it's unlikely to be a Terminator/Matrix/Hollywood scenario or really any specific enumeration. What further convinced me that the likely outcome is still negative for humanity, in the event of people making an honest but uninformed attempt at after having created an AGI making sure it won't be net-negative for humanity, is understanding the complexity of human value and how almost right is still very wrong. (http://wiki.lesswrong.com/wiki/Complexity_of_value)

Re:Andrew Ng: Why 'Deep Learning' Is a Mandate for Humans, N... by sampo on Tuesday May 05, 2015 @04:27PM (#9494749)
Kind of like a gorilla trying to predict what humans will do?
Re:Andrew Ng: Why 'Deep Learning' Is a Mandate for Humans, N... by rndn on Tuesday May 05, 2015 @05:47PM (#9495201)
Exactly. However, a superintelligence might by vastly more superior to us than we are to chimps: http://intelligenceexplosion.com/wp-content/uploads/2011/12/...

I actually don't quite agree with the spaces on this chart because the scientific method should set us far apart from mice and chimps so that they would almost merge in a single point.

Anyway, there are a handful of reasons to assume that an artificial general intelligence would likely turn out to be far superior to us: (1) Hardware is a much less noisy computation environment compared to the badly insulated neurons in our wetware (though this might be a feature rather than a bug), (2) our neurons operate at about 200 Hz, microchips at 10 million as much, (3) they would have extremely fast access to physical simulations and other computational resources, knowledge bases, other AIs, (4) they would never get tired, no body to maintain, no social obligations, and (5) they could replicate within seconds and easily modify their own sourcecode.

Re:Andrew Ng: Why 'Deep Learning' Is a Mandate for Humans, N... by superdude264 on Wednesday May 06, 2015 @01:11AM (#9496698)
These machines also use vastly more energy than a human brain.
Re:Andrew Ng: Why 'Deep Learning' Is a Mandate for Humans, N... by rndn on Wednesday May 06, 2015 @11:01AM (#9499119)
Oh right, forgot about that one.
Re:Andrew Ng: Why 'Deep Learning' Is a Mandate for Humans, N... by gohrt on Tuesday May 05, 2015 @08:36PM (#9495932)
> then you should set your expectation to be the outcome of any random one of possible superintelligent mind designs.

And how did you assign weights to these options?

I assume you didn't make the sophomore mistake of assuming a uniform distribution over all possibilities.