News for hackers. Stuff that matters.
Re:Should AI Be Open? by mindcrime on Thursday December 17, 2015 @05:45PM (#10755185)
The AI becomes much smarter than us and potentially destroys everyone and everything we care about. Unless you are supremely confident in humanity's intelligence, you should be concerned about AI risk.

I acknowledge it as a real risk, but it's not terribly high on my personal list of things to worry about right now. I like what Andrew Ng said about how worrying about this now is "like worrying about over-population on Mars".

Re:Should AI Be Open? by ggreer on Thursday December 17, 2015 @05:58PM (#10755276)
Please notice that your reply is a different argument than the one you first put forth. Originally, you weren't worried about AI because you thought it could never –even in principle– vastly exceed human abilities. Now you're basically saying, "I don't need to worry because it won't happen for a long time." That is a huge amount of ground to cede.

I'm not so confident that human-level AI will take a long time. The timeline depends on algorithmic insights, which are notoriously difficult to predict. It could be a century. It could be a decade. Still, it seems like something worth worrying about.

Re:Should AI Be Open? by mindcrime on Thursday December 17, 2015 @06:08PM (#10755344)
Please notice that your reply is a different argument than the one you first put forth. Originally, you weren't worried about AI because you thought it could never –even in principle– vastly exceed human abilities.

I never said I wasn't worried about AI. You're extrapolating from what I did say; which I've said all along was just a thought experiment, not a position I'm actually arguing for.

Re:Should AI Be Open? by mattmanser on Friday December 18, 2015 @05:38AM (#10757767)
I really recommend you read Bostrom, he really does succinctly argue the relevant positions, if a bit drily.

It's one of those books that put the arguments so clearly you're suddenly catapulted to having a vastly superior knowledge of the subject than someone trying to do simple thought experiments.

Both of your arguments look out-dated if you're one of the people 'in the know'.

Also, I suggest looking a bit more into what's going on in machine learning, it's suddenly got far more sophisticated than I personally realized until a couple of months ago when I was chatting to someone developing in it at the moment.

Re:Should AI Be Open? by mindcrime on Friday December 18, 2015 @12:53PM (#10759752)
I actually have the Bostrom book, but just haven't found time to read it yet. But it is definitely in the queue!
Re:Should AI Be Open? by astrofinch on Friday December 18, 2015 @12:17AM (#10756782)
Or like worrying about global warming back when it would have been easier to prevent?

Ng's statement is, at best, equivalent to a student who is putting off starting their semester project until finals week. Yes it seems far away, but the future is going to happen.

Re:Should AI Be Open? by mindcrime on Friday December 18, 2015 @02:03AM (#10757126)
I don't know. I mean, we don't seem to even be close to actually beginning to colonize Mars, much less be close to the point of overpopulation. I think Ng's statement, formed in an analogy similar to yours, would be closer to

"a freshman student who is putting off studying for his Senior final project until his Senior year".

The question Ng asked was something like "is there any practical action we can take today, to address over-population on mars" as an analogy to "is there any practical step we can take today to address the danger of a super-AGI". And honestly, I'm not convinced there is anything practical to do about super-AGI today. Well, nothing besides pursuing the "open AI" strategy.

But I'm willing to be convinced otherwise if somebody has a good argument.

Re:Should AI Be Open? by astrofinch on Friday December 18, 2015 @04:13AM (#10757494)
Did you have thoughts on the FLI research priorities document?

http://futureoflife.org/data/documents/research_priorities.p...

Re:Should AI Be Open? by mindcrime on Friday December 18, 2015 @02:13PM (#10760311)
I wasn't familiar with that until now, but I'll definitely give it a look.