News for hackers. Stuff that matters.
Re:Should AI Be Open? by lmm on Friday December 18, 2015 @05:49AM (#10757804)
I'd say your ideas are more unlikely. You can't generalize from one example. An AI that hasn't gone though evolution is extremely unlikely to have the exact set of complex wants and needs that humans have.

And even if you're right, as Alexander says, in that case why the need to open-source it? If you think it's important that AI is open-source and not controlled by e.g. Facebook, that must be because you think AI is going to be powerful and effective. In which case it's as dangerous as he says.

Re:Should AI Be Open? by Chathamization on Friday December 18, 2015 @09:09AM (#10758464)
But it's not a generalization from one example; I'm giving a string of different possibilities, based on the fact that we only have a single point of data. People seem to readily except that particular scenario - the "AI as smart as John von Neumann on modafinil, that never thinks about food/sex/art/etc., that never sleeps, that has access to Wikipedia etc. at the speed of thought, and no morals" scenario - based on zero evidence that an AI would actually be like that.

People seem more ready to accept the idea that an artificial general intelligence would act similar to it's portrayed in SciFi stories than accept that it might act similar to the other general intelligences we can observe (namely ourselves).

Re:Should AI Be Open? by lmm on Friday December 18, 2015 @09:32AM (#10758606)
But all of your possibilities are ridiculously human-parochial. And they all boil down to "the AI might have diverse interests", which is very unlikely - we have them as a result of evolution, but an AI created by human programmers would very likely have only one driving interest. And whether that interest was food, sex, art, or some particular notion of morality, the result would be equally terrible.