News for hackers. Stuff that matters.
Re:The world’s biggest problems and why they’re not what fir... by Analemma_ on Tuesday May 30, 2017 @12:40AM (#14443035)
Aaaand the top thing on the list is AI x-risk. Of course.

If there's anyone left in EA willing to listen: I'm begging you, please stop this foolishness. To everyone outside the bubble, you look like lunatics, and it has done immense and possibly irreparable damage to the EA "brand" which could otherwise be capable of such great things.

Re:The world’s biggest problems and why they’re not what fir... by probably_wrong on Tuesday May 30, 2017 @06:11AM (#14444159)
I know this is going to sound mean, but I hope it drives the point across: have the EA people actually done something so far? Besides talking, I mean.

I have yet to see a single AI's malicious behavior stopped by a proponent of AI risk, and that's considering that today's AI is still pretty dumb. I want to believe that they have released code, a specific policy, or something that I can use right now to stop the dumbest of botnets, but I'm not aware of anything.

Anyone better informed that me could chime in?

Re:The world’s biggest problems and why they’re not what fir... by tgb on Tuesday May 30, 2017 @09:10AM (#14445038)
Why is that the metric that you would judge EA on? Huge portions of EA are entirely uninterested in AI risk. And AI risk isn't interested in botnets. Honestly, have you read any of their material? If not, that's fine you don't have to be interested in it (it's getting plenty of attention at the moment and really is no longer a neglected cause) but why bother criticizing something you haven't attempted to understand?

Either way, MIRI has published some papers that they think are working towards their goal. https://intelligence.org/research/ I'm not well informed enough on this subject to try to judge that claim, though, and overall I'm conflicted as to how important I should rate AI risk. But I think having some people work on it is good, in much the same way that I value basic science research.

Re:The world’s biggest problems and why they’re not what fir... by henryaj on Tuesday May 30, 2017 @09:15AM (#14445070)
> have the EA people actually done something so far?

In terms of stuff done: OpenPhil, an EA org, has given north of $30million to groups researching strong AI and its risks[0]. Some effective altruists also choose to donate to AI research groups like MIRI[1].

Why would stopping a botnet be evidence of effectiveness at tackling strong AI? Botnets don't exhibit any kind of intelligence as far as I'm aware.

0. http://www.openphilanthropy.org/giving/grants

1. http://effective-altruism.com/ea/14c/why_im_donating_to_miri...

Re:The world’s biggest problems and why they’re not what fir... by probably_wrong on Tuesday May 30, 2017 @12:12PM (#14446322)
> Why would stopping a botnet be evidence of effectiveness at tackling strong AI?

Because it's much, much easier than their ultimate goal, and you could generalize from there, like biologists do.

But also: because it would show that they have more claws that (say) Asimov, who gave clear lines about what a robot should not do, and yet is entirely powerless to stop anyone from making such a robot.

If they want to stop strong AI, shouldn't they be able to actually stop first regular, weak AI? And if they want to stop weak intelligence, shouldn't they be able to stop a barely intelligent botnet first?

Re:The world’s biggest problems and why they’re not what fir... by BenjaminTodd on Tuesday May 30, 2017 @06:26PM (#14449062)
There's also real research progress being made. Here are some of the issues people are working on:

https://arxiv.org/abs/1606.06565

Re:The world’s biggest problems and why they’re not what fir... by lkbm on Tuesday May 30, 2017 @09:24AM (#14445138)
> have the EA people actually done something so far? Besides talking, I mean.

Yes: Donated money: https://www.givingwhatwecan.org/

I primarily give to the Against Malaria Fund and GiveDirectly. Some others donate to AI-relate research.

I personally haven't spent any time as an AI researcher OR as a malaria-net seamster. Does that mean I haven't done anything? Or does donating tens of thousands of dollars for bed nets count?

If that counts, why wouldn't donating to causes like AI risk count?

Re:The world’s biggest problems and why they’re not what fir... by rspeer on Tuesday May 30, 2017 @07:50AM (#14444566)
They're so worried about AGI, which doesn't exist, that they won't spend any time on the non-existential risks of non-general AI.

Listen to Cathy O'Neil for a more reasonable and actionable perspective on how we need to fix AI.

Re:The world’s biggest problems and why they’re not what fir... by probably_wrong on Tuesday May 30, 2017 @08:09AM (#14444647)
Anything specific that I should listen to? She seems to be a prolific writer, and I'm not sure where to start.
Re:The world’s biggest problems and why they’re not what fir... by rspeer on Tuesday May 30, 2017 @08:58AM (#14444962)
I suggest her book "Weapons of Math Destruction" in particular.
Re:The world’s biggest problems and why they’re not what fir... by notahacker on Tuesday May 30, 2017 @08:46AM (#14444872)
You're actually being too kind. The only three "recommended" causes to give money to are "research organizations like the unusual ones we're involved with". Everything else, from global health to climate change is lower priority they'd caution you to only "sometimes" give money to.

This isn't research, it's a thinly disguised and exceptionally cynical fundraising pitch.

Which is a shame, because I actually really like the basic idea behind 8000hours

Re:The world’s biggest problems and why they’re not what fir... by BenjaminTodd on Tuesday May 30, 2017 @06:30PM (#14449078)
We're going to work on the causes that we think our most pressing, so to be consistent, we're going to end up recommending the same things we work on.

At 80,000 Hours, our focus is also not on giving money. We're trying to help people find jobs in these areas, often in academia or policy and many other sectors.

Re:The world’s biggest problems and why they’re not what fir... by akvadrako on Tuesday May 30, 2017 @04:50AM (#14443803)
Although I consider AI risks more significant than everything else combined, you do have a point. The danger isn't communicated well and on top of that, nobody has a good defensive plan (IMHO).

That means attacking the problem directly isn't an effective approach. Especially if it creates AI-risk fatigue.

Re:The world’s biggest problems and why they’re not what fir... by chriswarbo on Tuesday May 30, 2017 @08:30AM (#14444780)
Agreed. The immediate action we should be taking to mitigate AGI risk is basically identical to the immediate action we should already be taking to research, regulate, hold-accountable, etc. existing dumb-AI systems (e.g. autonomous/remote-control killing machines, black-box oracles being used for medical diagnoses/credit/etc., economic impacts w.r.t. increasing inequality, "taking our jobs", etc.). Even Barack Obama has said as much, so I think all of the sky-is-falling social media buzz is just a hindrance.

We should absolutely be funding blue-sky research into mitigating, predicting, controlling, etc. AGIs if/when they're developed. But we are doing that (e.g. intelligence.org ) so, again, the doomsday prophets aren't contributing anything.

Re:The world’s biggest problems and why they’re not what fir... by dmichulke on Tuesday May 30, 2017 @05:15AM (#14443918)
I've been working on "general" AI quite a few years, both academically and professionally and IMO we're decades away from anything general, let alone the singularity.

Given this, I wonder where is the bubble. Of course, I see a lot of blog posts and hype, startups here and there, companies pouring billions into "AI".

Yet, I cannot participate in that bubble because:

- big companies (GOOG and the likes) are not positioned for AI only and are quite expensive already (maybe it's rather a tech or even stock market bubble there)

- small companies (I assume) are mostly start-ups, so there is no way to "get in" except as a VC

So yes, I see the signs of the bubble but I don't see where "mom and pop" come into play there.

Any suggestions as to what makes this bubble a real investment bubble? Or does bubble in this case mean something different?

Re:The world’s biggest problems and why they’re not what fir... by jholman on Tuesday May 30, 2017 @05:24AM (#14443976)
By "bubble", Analemma meant a distorting metaphorical sphere of delusion. Like "filter bubble", but more general. I think your first paragraph means you agree with the analysis.

There's also an investment surge in AI, which might be a bubble, but if you're asking how to participate, then I suspect you're not going to get to participate. Plus, the word "bubble", in the context of investment, means something about to pop. If it's an actual investment bubble, you don't want in.

Re:The world’s biggest problems and why they’re not what fir... by BenjaminTodd on Tuesday May 30, 2017 @06:31PM (#14449090)
We think even if AGI is only invented in 50 years, then it's still worth doing some work on the control problem today, so our view isn't that dependent on whether we're currently in an AI investment bubble or not.

However, if you did really believe the hype, and think that ML will lead to major breakthroughs in the next decade or so, then that would make it even more urgent.

Re:The world’s biggest problems and why they’re not what fir... by ramchip on Tuesday May 30, 2017 @04:02AM (#14443629)
EA?
Re:The world’s biggest problems and why they’re not what fir... by enruwhuy on Tuesday May 30, 2017 @04:31AM (#14443731)
Effective altruism, I guess?
Re:The world’s biggest problems and why they’re not what fir... by ramchip on Thursday June 01, 2017 @11:23AM (#14461028)
Thanks, looks like it indeed.