News for hackers. Stuff that matters.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by onion2k on Wednesday March 09, 2016 @03:08AM (#11251603)
Yet people will still tell that worrying about AI taking over is like worrying about overpopulation on Mars, and that this is a problem at least 50 years out.

As hard as writing AI for a problem space like "how to win at Go" is, it's several orders of magnitude easier than creating a general AI with the self-awareness required to see us as a threat.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Wednesday March 09, 2016 @04:07AM (#11251810)
There is a lot of progress being made in AI right now. Hard problems that were expected to take decades, are being beaten regularly. Who is to say how much AI could advance in the next 20-30 years? Do you really believe there's less than a 50% chance strong AI won't be invented in your lifetime?
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by onion2k on Wednesday March 09, 2016 @06:10AM (#11252221)
There is a lot of progress being made in AI right now. Hard problems that were expected to take decades, are being beaten regularly. Who is to say how much AI could advance in the next 20-30 years?

"We've beaten some hard problems more quickly than expected therefore we'll likely beat other hard problems more quickly than expected" is logical induction. It's equivalent to "I just flipped a coin and got heads. I'll probably get heads again on the next flip." Don't do that. :)

Do you really believe there's less than a 50% chance strong AI won't be invented in your lifetime?

I don't know. I don't really see the value in speculating.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Wednesday March 09, 2016 @02:02PM (#11254958)
>I just flipped a coin and got heads. I'll probably get heads again on the next flip

Which is corrrect, if you don't know the true probability of flipping heads. You might find, for example, that it's a trick coin with two heads and no tails.

You absolutely can predict future progress from past progress. E.g. Moore's law held true for decades after the observation was made. If you see a technology advancing rapidly, then there is no reason to say it will stop in the near future!

>I don't really see the value in speculating.

Because everything depends on this prediction. The invention of AI will be the most significant event in the history of humanity. It will totally change the world. Or likely, destroy it. Being prepared for it is absolutely necessary.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:31PM (#11255875)
No, not if you have a strong prior belief that coins in general are fair.

By your logic, you can predict the failure of AGI predictions by past failures of (every) AGI prediction.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Thursday March 10, 2016 @02:44PM (#11261690)
>No, not if you have a strong prior belief

Why would you have a strong prior belief about the invention of AGI? Now you are claiming to have far more certainty than I am.

>By your logic, you can predict the failure of AGI predictions by past failures of (every) AGI prediction.

This logic is extremely flawed. First not every prediction was wrong. Many people predicted it would happen in 2045, a few in 2030.

Second there's no reason past predictions represent the accuracy of future predictions about the same thing. Predictions should get more accurate over time, and early predictions are expected to be wildly wrong.

And third there's anthropic bias. If they were right, then we wouldn't be here to speculate about it. We can only ever observe negative outcomes, therefore observing a negative outcome shouldn't update your priors at all.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Friday March 11, 2016 @07:53AM (#11266294)
I was refuting your coin argument, which was pretty ridiculous, if I do say so.

The vast majority of predictions were wrong.

Yes, the logic is flawed, that's why I said it was your logic.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by pixl97 on Wednesday March 09, 2016 @10:16AM (#11253402)
>I don't really see the value in speculating.

There is all kinds of value in speculating. We do it all the time in things like war games. 'If neighbor $x attacked us, what would happen?, would they win?, what can we do to prevent this?'.

Of course this may in your mind hold very little value now, but I promise if and when it occurs you will change your mind quickly on that topic.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by PascalsMugger on Wednesday March 09, 2016 @10:25AM (#11253463)
Do you think it's better to propose we won't, and not start preparing for a smarter-than-human intelligence. Or to propose we might, and that we should prepare for it to happen?
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by onion2k on Wednesday March 09, 2016 @11:20AM (#11253811)
On the face of it we should definitely have a strategy for dealing with strong AI, but with no knowledge of what strong AI will look like how would we prepare for it? There's ostensibly nothing we can do. Until we make more progress in the field we can't make any preparations other than wild speculation. And that is what I see no value in.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by CamperBob2 on Wednesday March 09, 2016 @03:22AM (#11251648)
The interesting thing is that this algorithm taught itself to master the game. If you're writing a chess engine, you just "write the AI for the problem space" in a few dozen lines of code, as you put it, and let brute force do the rest. In the case of DeepMind, faced with a game where a traversal approach is numerically impossible, its programmers gave it the ability to improve by playing against itself.

That's the difference between a neural net -- which until about an hour ago was a phrase that reliably set off my snake-oil detector -- and a simple tree search. DeepMind just beat a Go master... and nobody can say exactly how it did it.

That's a big deal.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by riffraff on Wednesday March 09, 2016 @03:30AM (#11251685)
it is a big deal, but it is still very different from general AI, and we are very good at underestimating complexity.

Remember that "solve computer vision" was considered a summer project.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by faizshah on Wednesday March 09, 2016 @03:34AM (#11251702)
I think it's the same as what happened when the perceptron was the big thing in the 50s/60s. Many made far overreaching conclusions about how the problem of AI had been solved.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by CamperBob2 on Wednesday March 09, 2016 @02:00PM (#11254946)
Remember that "solve computer vision" was considered a summer project.

And they're pretty much there. Have you seen some of the latest results in that field?

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by riffraff on Wednesday March 09, 2016 @02:59PM (#11255374)
I think you misunderstood, I am referring to the fact that Marvin Minsky in 1966, asked Gerald Sussman to "spend the summer linking a camera to a computer and getting the computer to describe what it saw".

We certainly got nearly there, but it was nearly 50 years later, not 3 months. Similarly, something that might look somewhat simple to us right now, might also be a lot more difficult.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by CamperBob2 on Wednesday March 09, 2016 @03:25PM (#11255503)
I see what you mean -- sorry, I thought you were referring to a Summer of Code project.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by zodiac on Wednesday March 09, 2016 @04:09AM (#11251817)
> its programmers gave it the ability to improve by playing against itself

Good chess programs definitely use self-play to improve themselves, eg to tune parameters and heuristics.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by CamperBob2 on Saturday March 12, 2016 @03:47PM (#11274480)
They don't invent moves that they weren't explicitly programmed to play, though, do they? People at the top level of play have been beaten by chess programs but not surprised by them, the way the Go professionals have been in this case. DeepBlue didn't teach us anything about chess that we didn't already know.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by pfisch on Wednesday March 09, 2016 @03:23AM (#11251655)
In other words, it could be created in the next 10 to 20 years.

We should be taking steps to outlaw black box algorithms right now but I'm sure we won't.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by pgodzin on Wednesday March 09, 2016 @04:53AM (#11251969)
How do you outlaw black box algorithms? What is a black box algorithm? Should we outlaw all calls to libraries we don't have the complete source code to?

I can't understand the call to regulate a technology when it is decades (much more that 10-20 years) away from possibly existing in a state that we can't even imagine. Add to that legislators with zero technical literacy. That's essentially advocating for shutting down all research into a technology that can improve millions of lives.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by pfisch on Monday March 14, 2016 @04:13AM (#11281601)
A black box algorithm is any algorithm that wasn't really written by a human. It isn't about having the source code, it is about utilizing the output of a neural network, which is built up by multiplying a bunch of inputs by weight values and is basically nonsense when you look at it.

Basically any algorithm where you are training it with tons of samples and then it creates a logic tree that is not written by a human is a black box algorithm.

By the time AI technology gets to the point that we realize we should regulate it we will be too late.