News for hackers. Stuff that matters.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by 21 on Wednesday March 09, 2016 @02:47AM (#11251511)
The thing that was supposed to take at least 10 years happened. Only last month people were still saying that no way AlphaGo will beat the champion and that it will be crushed. Today everybody will have seen it coming and say that it was normal.

Yet people will still tell that worrying about AI taking over is like worrying about overpopulation on Mars, and that this is a problem at least 50 years out.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by simonh on Wednesday March 09, 2016 @03:19AM (#11251639)
Highly optimised single-function algorithms like this are impressive stuff and can lead to useful tools, but that's it. This gets us no closer to strong AI than a tic tac toe program. Until we have systems that can tackle a wide range of fundamentally different problems and independently adapt strategies for dealing with one class of problems to deal with other classes of problems, systems like Alphago will remain one trick wonders with little relevance to 'true' AI.

Edit: I do understand that the techniques used to implement Alphago can be used to implement other single-function solvers. That doesn't make it a general purpose strong AI.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Wednesday March 09, 2016 @03:55AM (#11251759)
Welcome to the AI effect! Every time AI makes an accomplishment, it is disregarded. The goalposts are perpetually moved. "AI is whatever computers can't do yet."

People said for years that Go would never be beaten in our lifetime. They said this because Go has a massive search space. It can't be beaten by brute force search. It requires intelligence, the ability to learn and recognize patterns.

And it requires doing that at the level of a human. A brute force algorithm can beat humans by doing a stupid thing far faster than a human can. But a pattern recognition based system has to beat us by playing the same way we do. If humans can learn to recognize a specific board pattern, it also has to be able to learn that pattern. If humans can learn a certain strategy, it also has to be able to learn that strategy. All on it's own, through pattern recognition.

And this leads to a far more general algorithm. The same basic algorithm that can play Go, can also do machine vision, it can compose music, it can translate languages, or it could drive cars. Unlike the brute force method that only works one one specific task, the general method is, well, general. We are building artificial brains that are already learning to do complex tasks faster and better than humans. If that's not progress towards AGI, I don't know what is.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:12AM (#11251825)
The "moving goalposts" argument is one that really needs to die. It's a classic empty statement. Just because other people made <argument> in the past does not mean it's wrong. It proves nothing. People also predicted AGI many times over-optimistically; probably just as often as people have moved goalposts.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Wednesday March 09, 2016 @02:11PM (#11255025)
I don't know what you are trying to say. I'm making an observation that whenever AI beats a milestone, there are a bunch of pessimists that come out and say "but obviously X was beatable by stupid algorithms. I will beleive AI is making progress when it beats Y!"

Those arguments absolutely are wrong. For one thing it's classic hindsight bias. When you make a wrong prediction, you should update your model, not come up with justifications why your model doesn't need to change.

But second, it's another bias, where nothing looks like AI, or AI progress. People assume that intelligence should be complicated, that simple algorithms can't have intelligent behavior. That human intelligence has some kind of mystical attribute that can't be replicated in a computer.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:37PM (#11255917)
I said exactly what I said. Calling out "moving the goalposts" does not refute the assertion that this does not get us nontrivially closer to AGI.

Whenever AI beats a milestone, there are a bunch of over-optimists that come out and make predictions about AGI. They have been wrong over and over again over the course of half a century. It's classic hindsight bias.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Thursday March 10, 2016 @02:48PM (#11261716)
Yes it does! If you keep changing what you consider "AI", every time it makes progress, then it looks like we are never getting closer to AI. When in fact it is just classic moving goalposts.

And the optimists are being proven right. AGI is almost here.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Friday March 11, 2016 @07:57AM (#11266316)
This doesn't address my argument at all.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by fma on Wednesday March 09, 2016 @07:52AM (#11252643)
As far as I know the goal post of Turing test has never moved.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Wednesday March 09, 2016 @02:23PM (#11255120)
That's because it hasn't been beaten yet! As soon as a chatbot beats a turing test, there will be a lot of AI deniers come out and say that the Turing test doesn't measure 'real' intelligence, or isn't a valid test for <reasons>.

I know this is true, because there are already a lot of people that think the Turing test isn't valid. They believe it could be beaten by a stupid chatbot, or deception on the part of AI. Just search for past discussions on HN of the Turing test, it comes up a lot.

There is no universally accepted benchmark of AI. Let alone a benchmark for AI progress, which is what Go is.

No one claimed that Go would require a human level AI to beat. But I am claiming that beating it represents progress towards that goal. Whereas passing the Turing test won't happen until the very end. Beating games like Go are little milestones along the journey.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by simonh on Thursday March 10, 2016 @04:56AM (#11258221)
Viewed that way, I'll accept that beating Go represent progress. That's not the same as saying that it represents imminent evidence that singularity style strong AI is almost upon us, as suggested in the post I was replying to. In the long term it might turn out to represent very minimal progress towards that goal.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Mangalor on Wednesday March 09, 2016 @11:30AM (#11253870)
Chatbots can already beat the turing test.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by simonh on Wednesday March 09, 2016 @01:01PM (#11254513)
Chatbots ate trivially easy to beat. Just try teaching it a simple game and ask it to play it with you. Basically any questions that require it to form a mental model of something and mutate or interrogate the model state.

Many of the chatbot Turing test competitions have heavily rigged rules restricting the kinds of questions you're allowed to ask in order to give the bots a chance.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by sweezyjeezy on Wednesday March 09, 2016 @11:57AM (#11254045)
Only for bad judges. Just ask any AI - 'what flavour do you reckon a meteorite is' or something weird like that, and watch it try and equivocate.

(the answer is Rocky Road by the way)

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Eliezer on Wednesday March 09, 2016 @03:28AM (#11251674)
In case you're not aware, AlphaGo's key component is based on the same type of Deepmind system that learned to play dozens of Atari games, to superhuman levels, by watching the pixels, without any programmatic adaptation to the particular Atari game. At least the version of AlphaGo that played in October was far less specialized for Go than Deep Blue was for chess. Demis Hassabis says that next up after this is getting Deepmind to play Go without any programmatic specialization for Go. Your reply would be appropriate if we were talking about Deep Blue, chess, and 1997.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Fede_V on Wednesday March 09, 2016 @03:49AM (#11251742)
That's incorrect. The features that AlphaGo uses are not pixel level features, but board states - and the architecture between AlphaGo and the Atari network is completely different.

It's still an incredibly achievement - but it's important to be accurate.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by DavidSJ on Wednesday March 09, 2016 @04:43AM (#11251931)
For AlphaGo, a "pixel" is a point on the board. It uses essentially the same convolutional neural networks (CNNs) that are in state-of-the-art machine vision systems. But yes, the overall architecture is rather different from the Atari system, due to the integration of that CNN with Monte Carlo Tree Search.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by drawnwren on Wednesday March 09, 2016 @06:01AM (#11252194)
Sorry, you're off base a bit. The Atari system did use a Deep Neural Network / Reinforcement algorithm, but as the original poster was trying to point out, the rules of Go were very much hard coded into AlphaGo. From what this [1] says, multiple DNNs are learning how to traverse Monte Carlo trees of Go games. The reinforcement piece comes in choosing which of the Go players is playing the best games.

While the higher portions do share some similarities with the Atari system, at a basic level this is a machine that was designed and trained to play Go. AlphaGO is 'essentially the same' as the Atari system in the same way that all Neural Networks are 'essentially the same.'

Is this an extremely impressive accomplishment? Yes. However, doesn't seem to qualify as anything close to generalizable.

[1] http://googleresearch.blogspot.com/2016/01/alphago-mastering...

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by DavidSJ on Wednesday March 09, 2016 @06:55AM (#11252398)
I didn't say AlphaGo is essentially the same as Deep Q Networks. I said the convolutional neural network part of it is essentially the same. We agree that the integration of that CNN into the rest of the system is very different.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Wednesday March 09, 2016 @02:56PM (#11255350)
It's best to say that alphago uses neural networks, which are extremely general. The same way planes and cars both use internal combustion engines. ICEs are extremely general. They produce mechanical energy from gas, and are totally uncaring whether you put them into a plane or a car. The body of the plane is necessary, but isn't really the interesting part.

Likewise NNs are uncaring what application you put them into. Give them a different input and a different goal, and they will learn to do that instead. Alphago gave it's NN's control over a monte carlo search tree, and that turned out to be enough to beat Go. They could plug the same AI into a car and it would learn to control that instead.

Note that even without the monte carlo search system, it was able to beat most amateurs, and predict the moves experts would make most of the time.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:27PM (#11255846)
Even without the neural net system, AI is able to beat most amateurs, and predict moves experts would make.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Thursday March 10, 2016 @02:23PM (#11261481)
I'm not sure that's correct. MCTS has well known weaknesses, and isn't even a predictive algorithm. MCTS on it's own couldn't get anywhere near beating the top Go champion, that requires deepminds neural networks.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Friday March 11, 2016 @07:55AM (#11266304)
http://www.milesbrundage.com/blog-posts/alphago-and-ai-progr...

The best Go program before AlphaGo was CrazyStone, ranked at 5-dan ("high amateur" range).

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Friday March 11, 2016 @03:25PM (#11269241)
There's a massive skill difference between ameatures and professionals. It couldn't even beat the top ameatures.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Saturday March 12, 2016 @02:39AM (#11271742)
Which is why I said the intuition was amateur-pro level. I did not say it could beat every amateur-pro in the world.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by eru on Wednesday March 09, 2016 @06:13AM (#11252235)
Actually, putting a piece of software in front that infers board states from a video feed would be an easy problem.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Fede_V on Wednesday March 09, 2016 @06:26AM (#11252274)
That's actually true - going from the pixel level to the board state is trivial and not particularly interesting.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by eru on Wednesday March 09, 2016 @06:44AM (#11252345)
It's trivial today. It would have been interesting perhaps twenty years ago?
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @07:12AM (#11252463)
No, because even handcrafted computer vision systems from 20 years ago would be able to parse a Go board (edge detection + check the color contrast).
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by eru on Wednesday March 09, 2016 @05:53PM (#11256281)
True. I guess you'd have to go even further back.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by YeGoblynQueenne on Wednesday March 09, 2016 @01:16PM (#11254606)
>> In case you're not aware, AlphaGo's key component is based on the same type of Deepmind system that learned to play dozens of Atari games, to superhuman levels, by watching the pixels, without any programmatic adaptation to the particular Atari game.

The Atari-playing AI watched the pixels indeed, but it was also given a set of actions to choose from and more importantly, a reward representing the change in the game score.

That means it wasn't able to learn the significance of the score on its own, or to generalise from the significance of the changing score in one game, to another.

It also played Atari games, that _have_ scores, so it would have been completely useless in situations where there is no score, or a clear win/loss situation.

AlphaGo is also similarly specialised to play Go. As is machine learning in general: someone has to tell the algorithm what it needs to learn, either through data engineering, or reward functions etc. A general AI would learn what is important on its own, like humans do, so machine learning has not yet shown that it can develop into AGI.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Wednesday March 09, 2016 @02:48PM (#11255299)
I think you are confusing utility functions with intelligence. All AIs need utility functions. An AI without a utility function would just do nothing. It would have no reason to beat Atari games, because it wouldn't get any reward for doing so.

Even humans have utility functions. For example, we get rewards for having sex, or eating food, or just making social relationships with other humans. Or we have negative reinforcement from pain, and getting hurt, or getting rejected socially.

You can come up with more complicated utility functions. Like instead of beating the game, it's goal could be to explore as much of the game as possible. To discover novel things in the game. Kind of like a sense of boredom or novelty that humans have. But in the end it's still just a utility function, it doesn't change how the algorithm itself works to achieve it. AGI is entirely agnostic to the utility function.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by YeGoblynQueenne on Wednesday March 09, 2016 @08:07PM (#11256809)
>> I think you are confusing utility functions with intelligence.

No, what I'm really saying is that you can't have an autonomous agent that needs to be told what to do all the time. In machine learning, we train algorithms by giving them examples of what we want them to learn, so basically we tell them what to learn. And if we want them to learn something new, we have to train them again, on new data.

Well, that's not conducive to autonomous or "general" intelligence. There may be any number of tasks that your "general" AI will need to perform competently at. What's it gonna do? Come back to you and cry every time it fails at something? So then you have a perpetual child AI that will never stand on its own two feet as an adult, because there's always something new for it to learn. Happy little AI, for sure, but not very useful and not very "general". Except for a general nuisance, maybe.

Edit: I'm saying that machine learning can't possibly lead to general AI, because it's crap at learning useful things on its own.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Thursday March 10, 2016 @02:39PM (#11261650)
Machine learning doesn't "need to be told what to do all the time". No one told alphaGo what strategies were the best. It figured that out on it's own, by playing against itself.

There is also unsupervised and semi-supervised learning, which can take advantage of unlabelled data. Even supervised learning can work really well on weakly labelled data. E.g. taking pictures from the internet and using the words that occur next to them as labels. As opposed to hiring a person to manually label all of them.

I don't know what situation you are imagining that would make the AI "come back and cry". You will need to give an example.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by YeGoblynQueenne on Thursday March 10, 2016 @08:29PM (#11264026)
>> Machine learning doesn't "need to be told what to do all the time". No one told alphaGo what strategies were the best.

Of course they did. They trained it with examples of Go games and they also programmed it with a reward function that led it to select the winning games. Otherwise, it wouldn't have learned anything useful.

>> There is also unsupervised and semi-supervised learning, which can take advantage of unlabelled data.

Sure, but unsupervised learning is useless for learning specific behaviours. You use it for feature discovery and data exploration. As to semi-supervised learning, it's "semi" supervised: it learns its own features, then you train it with labels so that it learns a mapping from those features it discovered to the classes you want it to output.

>> I don't know what situation you are imagining that would make the AI "come back and cry"

That was an instance of humour [1].

[1] https://en.wikipedia.org/wiki/Humour

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Thursday March 10, 2016 @10:34PM (#11264492)
>Of course they did. They trained it with examples of Go games and they also programmed it with a reward function that led it to select the winning games. Otherwise, it wouldn't have learned anything useful.

Yes, but it doesn't need to be trained with examples of Go games. It helps a lot, but it isn't 100% necessary. It can learn to play entirely through self play. The atari games were entirely self play.

As for having a reward function for winning games, of course that is necessary. Without a reward function, any AI would cease to function. That's true even of humans. All agents need reward functions. See my original comment.

>That was an instance of humour

Yes I know what humour is lel. I asked you for a specific example where you think this would matter. Where your kind of AI would do better than a reinforcement learning AI.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by YeGoblynQueenne on Friday March 11, 2016 @04:09AM (#11265556)
>> The atari games were entirely self play.

That's reinforcement learning and it's even more "telling the computer what to do" than teaching it with examples.

Because you're actually telling it what to do to get a reward.

>> Without a reward function, any AI would cease to function.

I can't understand this comment, which you made before. Not all AI has a reward function. Specific algorithms do. "All" AI? Do you mean all game-playing AI? Even that's stretching it, I don't remember minimax being described in terms of rewards say, and I certainly haven't heard any of about a dozen classifiers I've studied and a bunch of other systems of all sorts (not just machine learning) being described in terms of rewards either.

Unless you mean "reward function" as the flip side of a cost function? I suppose you could argue that- but could you please clarify?

>> your kind of AI

Here, there's clearly some misunderstanding because even if I have a "my kind" of AI, I didn't say anything like that.

I'm sorry if I didn't make that clear. I'm not trying to push some specific kind of AI, though of course I have my preferences. I'm saying that machine learning can't lead to AGI, because of reasons I detailed above.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Friday March 11, 2016 @03:31PM (#11269273)
>That's reinforcement learning and it's even more "telling the computer what to do" than teaching it with examples.

No one tells the computer what to do. They just let it do it's thing, and give it a reward when it succeeds.

>Not all AI has a reward function. Specific algorithms do. "All" AI?

Fine, all general AI. Like game playing etc. Minimax isn't general, and it does require a precise "value function" to tell it how valuable each state is. Classification also isn't general, but it also requires precise loss function.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by YeGoblynQueenne on Saturday March 12, 2016 @06:36AM (#11272432)
>> No one tells the computer what to do.

Sure they do. Say you have a machine learning algorithm, that can learn a task from examples, and let's notate it like so:

y = f(x)

Where y is the trained system, f the learning function and x the training examples.

The "x", the training examples, is what tells the computer what to learn, therefore, what to do once it's trained. If you change the x, the learner can do a different y. Therefore, you're telling the computer what to do.

In fact, once you train a computer for a different y, it may or may not be really good at it, but it certainly can't do the old y anymore. Which is what I mean by "machine learning can't lead to AGI". Because machine learning algorithms are really bad at generalising from one domain to another, and the ability to do so is necessary for general intelligence.

Edit: note that the above has nothing to do with supervised vs unsupervised etc. The point is that you train the algorithm on examples, and that necessarily removes any possibility of autonomy.

>> Fine, all general AI. Like game playing etc.

I'm still not clear what you're saying; game-playing AI is not an instance of general AI. Do you mean "general game-playing AI"? That too doesn't always necessarily have a reward function. If I remember correctly for instance, Deep Blue did not use reinforcement learning and Watson certainly does not (I got access to the Watson papers, so I could double-check if you doubt this).

Btw, every game-playing AI requires a precise evaluation function. The difference with machine-learned game-playing AI is that this evaluation function is sometimes learned by the learner, rather than hard-coded by the programmer.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Sunday March 13, 2016 @02:54PM (#11278844)
The thing about neural networks is they can generalize from one domain to another. We don' have a million different algorithms, one for recognizing cars, and another for recognizing dogs, etc. They learn features that both have in common.

>The "x", the training examples, is what tells the computer what to learn, therefore, what to do once it's trained. If you change the x, the learner can do a different y. Therefore, you're telling the computer what to do.

But with RL, a computer can discover it's own training examples from experience. They don't need to be given to it.

>I'm still not clear what you're saying; game-playing AI is not an instance of general AI.

But it is! The distinction between the real world and a game is arbitrary. If an algorithm can learn to play a random video game, you can just as easily plug it into a robot and let it play "real life". The world is more complicated, of course, but not qualitatively different.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by empath75 on Wednesday March 09, 2016 @08:11AM (#11252730)
1) this isn't a single function algorithm 2) the human mind is FULL of ugly, highly optimized hacks that accomplish one thing well enough for us to survive. Don't assume that human intelligence is this magical general intelligence, rather than a collection of single function algorithms.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:26PM (#11255837)
It is. Value and policy networks are nonlinear approximators for value and policy functions.

You're making the mistake of assuming anything about how the human brain learns.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by lololomg on Wednesday March 09, 2016 @03:26AM (#11251670)
'True AI will always be defined as anything a computer can not yet do'
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by ubernostrum on Wednesday March 09, 2016 @04:02AM (#11251785)
Sort-of repeating a comment I made last time AlphaGo came up:

As far as I know there is nothing particularly novel about AlphaGo, in the sense that if we stuck an AI researcher from ten years ago in a time machine to today, the researcher would not be astonished by the brilliant new techniques and ideas behind AlphaGo; rather, the time-traveling researcher would probably categorize AlphaGo as the result of ten years' incremental refinement of already-known techniques, and of ten years' worth of hardware development coupled with a company able to devote the resources to building it.

So if what we had ten years ago wasn't generally considered "true AI", what about AlphaGo causes it to deserve that title, given that it really seems to be just "the same as we already had, refined a bit and running on better hardware"?

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by nl on Wednesday March 09, 2016 @06:13AM (#11252231)
It's easy to say that, in the same way that people now wouldn't be surprised if we could factor large numbers in linear time if we had a functional quantum computer!!

10 years ago no one believed it was possible to train deep nets[1].

It wasn't until the current "revolution" that people learned how important parameter initialization was. Sure, it's not a new algorithm, but it made the problem tractable.

So far as algorithmic innovations go, there's always ReLU (2011) and leaky ReLU (2014). The one-weird-trick paper was pretty important too.

[1] Training deep multi-layered neural networks is known to be hard. The standard learning strategy— consisting of randomly initializing the weights of the network and applying gradient descent using backpropagation—is known empirically to find poor solutions for networks with 3 or more hidden layers. As this is a negative result, it has not been much reported in the machine learning literature. For that reason, artificial neural networks have been limited to one or two hidden layers

http://deeplearning.cs.cmu.edu/pdfs/1111/jmlr10_larochelle.p...

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by eru on Wednesday March 09, 2016 @06:14AM (#11252240)
Dropout (and maxout) might also count.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by fma on Wednesday March 09, 2016 @07:58AM (#11252676)
It's only difficult because no one threw money at it. It's like saying going to Mars is difficult. It is - but most of the technology is there already, just need money to improve what was used to go to the moon.

If you asked people 10 years ago before the moon landing if it was possible, I too would agree it's impossible. But after that breakthrough it opened up the realm is possibilities.

I see AlphaGo more of an incremental improvement than a breakthrough.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by oldmanjay on Wednesday March 09, 2016 @05:55PM (#11256296)
It's a basic human bias to believe that anything that you don't have to do (or know how to do) "just needs money" to get done.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by nl on Wednesday March 09, 2016 @10:50PM (#11257290)
So are you arguing that superhuman-level performance in just a matter of engineering effort? Or am I missing something?

I'm generally considered to be way over optimistic in my assessment of AI progress. But wow.. that's pretty optimistic!

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Thursday March 10, 2016 @07:21AM (#11258746)
I interpreted him as saying superhuman-performance at Go was just a matter of engineering effort, which I wholeheartedly agree with.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:30AM (#11251890)
Agreed. People don't realize that all of the huge algorithmic innovations (LSTMs, Convolutional neural networks, backpropagation) were invented in past neural net booms. I can't think of any novel algorithms of the same impact and ubiquity (e.g. universally considered to be huge algorithmic leaps) that have been invented in this current boom. The current boom started due to GPUs.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by nullc on Wednesday March 09, 2016 @05:29AM (#11252082)
Something being invented previously doesn't mean that it existed as a matter of engineering practicality; improved performance is some but not all of that. Just describing something in a paper isn't enough to make it have impact, many things described in papers simply don't work as described.

A decade ago I was trying and failing to build multi-layer networks with back-propagation-- it doesn't work so well. More modern, refined, training techniques seem to work much better... and today tools for them are ubiquitous and are known to work (especially with extra CPU thrown at them :) ).

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @07:01AM (#11252421)
Backpropagation and convolutional neural nets were breakthroughs that were immediately put to use.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Wednesday March 09, 2016 @03:06PM (#11255411)
The point is that no one could train deep nets 10 years ago. Not just because of computing power, but because of bad initializations, and bad transfer functions, and bad regularization techniques, etc.

These things might seem like "small iterative refinements", but they add up to 100x improvement. Even when you don't consider hardware. And you should consider hardware too, it's also a factor in the advancement of AI.

Also reading through old research, there is a lot of silly ideas along with the good ones. It's only in retrospect that we know this specific set of techniques work, and the rest are garbage. At the time it was far from certain what the future of NNs would look like. To say it was predictable is hindsight bias.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:27PM (#11255849)
They could. There was a different set of tricks that didn't work as well (greedy pretraining).
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by nullc on Wednesday March 09, 2016 @09:44PM (#11257137)
Lots of people tried and failed.

Today lots of people-- ones with even less background and putting in less effort-- try and are successful.

This is not a small change, even if it is the product of small changes.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Thursday March 10, 2016 @07:15AM (#11258717)
Reconnecting to my original point way up-thread, my point is these "innovations" have not substantially expanded the types of models we are capable of expressing (they have certainly expanded the size of the types of models we're able to train), not nearly to the same degree as backprop/convnets/LSTMs did way back decades ago (this is important because AGI will require several expansions in the types of models we are capable of implementing).
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Thursday March 10, 2016 @02:22PM (#11261461)
Right, LSTM was invented 20 years ago. 20 years from now, the great new thing will be something that has been published today. It takes time for new innovations to gain popularity and find their uses. That doesn't mean innovations are not being made!
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by lern_too_spel on Wednesday March 09, 2016 @10:44AM (#11253575)
Dropout and deep belief networks are significant recent algorithmic advances that are already widely used.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by lololomg on Wednesday March 09, 2016 @04:06AM (#11251809)
> As far as I know there is nothing particularly novel about AlphaGo,

By that standard there's nothing particularly novel about anything. Everything we have today is just a slight improvement of what we already had yesterday.

World experts in go and ML as recently as last year thought it would be many more years before this day happened. Who are you to trivialize this historic moment?

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:17AM (#11251841)
Some experts in Go less than 10 years ago believed it would be accomplished within 10 years. Also, you didn't actually refute his argument. Can you point to an algorithm that is not an incremental improvement over algorithms that existed 10 years ago? MCTS and reinforcement learning with function approximators definitely existed 20 years ago.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by kqr on Wednesday March 09, 2016 @06:20AM (#11252261)
No, that's what they're saying. Take any invention and you can break it down into just a slight improvement of the sub-inventions it consists of.

A light bulb is just a metal wire encased in a non-flammable gas and you run electricity through it. It was long known that things get hot when you run electricity through them, and that hot things burst into fire, and that you can prevent fire by removing oxygen, and that glass is transparent. It's not a big deal to combine these components. A lot of people still celebrate it as a great invention, and in my opinion it is! Think about how inconvenient gas lighting is and how much better electrical light is.

Same thing with AlphaGo. Sure, if you break it down to its subcomponents it's just clever application of previously known techniques, like any other invention. But it's the result that makes it cool, not how they arrived at it!

All algorithms are incremental improvements of existing techniques. This isn't a card you can use to diminish all progress as "just a minor improvement what's the fuss".

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @07:05AM (#11252443)
No, not all inventions are incremental improvements of existing techniques. Backpropagation and convolutional nets, for example. Now, you might counter with the fact that it's just the chain rule (and convolution existed before that), but the point is it that algorithm had never been used in machine learning before.

People have used neural nets as function approximators for reinforcement learning with MCTS for game playing well before AlphaGo (!!).

Your lightbulb example actually supports my point. The lightbulb was the product of more than a half-century of work by hundreds of engineers/scientists. I have no problem with pointing to 70 years of work as a breakthrough invention.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by FeepingCreature on Wednesday March 09, 2016 @04:18AM (#11251845)
I think the thing that would surprise a researcher from ten years ago is mainly the use of graphics cards for general compute. The shader units of 2005 would only be starting to get to a degree of flexibility and power where you could think to use them for gpgpu tasks.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by kybernetikos on Wednesday March 09, 2016 @03:52PM (#11255653)
I got my first consumer gpu in 1997 and was thinking about how to do nongraphical tasks on it almost immediately. I didn't come up with anything practically useful back then and they were much more limited but I don't think someone from 2006 would find it surprising to hear that this was a thing.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by mindcrime on Wednesday March 09, 2016 @09:03PM (#11257011)
I don't know... CUDA was released almost 9 years ago. So I don't think it's a stretch to suggest that cutting edge researchers from 10 years ago would have been thinking about using GPU's that way.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by nullc on Wednesday March 09, 2016 @05:23AM (#11252065)
Human mind... pshaw. You say this "human" thing is special? I don't see it: In my day we also had protons and electrons... all you're showing me is another mishmash of hadroic matter and leptons. So you've refined the arrangement here and there, okay, but I don't see any fundamental breakthrough only incremental refinement.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by lmm on Wednesday March 09, 2016 @06:15AM (#11252243)
The effectiveness? Ten years ago researchers thought humanlike intelligence must necessarily involve something more than simple techniques. Today that position becomes a lot harder to defend.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Confusion on Wednesday March 09, 2016 @05:04AM (#11252010)
You are not a general purpose strong AI either. Your mind could easily consist of a whole bunch of single-function solvers, combined into networked components.

See this interview between Kurzweil and Minsky: https://www.youtube.com/watch?v=RZ3ahBm3dCk#action=share

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by danielbarla on Wednesday March 09, 2016 @03:49AM (#11251740)
Regarding your edit, I'd wager that it won't stay true for long. Eventually the single-function problem of orchestrating and directing a bunch of sub-solvers in a similar manner to the human brain will become feasible. At that point true general purpose AI will exist, for all intents and purposes.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by PascalsMugger on Wednesday March 09, 2016 @10:08AM (#11253360)
And when that happens I guarantee someone will be on HN saying it is "trivial" and "not a real advancement" and "we already basically knew how to do this". Because that's what people say every time something interesting happens in AI, without fail.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by taneq on Wednesday March 09, 2016 @05:19AM (#11252051)
I don't think anyone's claiming that AlphaGo is an AGI in and of itself, just that it's a significant step towards one. There's still a lot to go before we can toss a standardized piece of hardware+code into an arbitrary situation and have it 'just figure it out'.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by JabavuAdams on Wednesday March 09, 2016 @07:48AM (#11252623)
> This gets us no closer to strong AI than a tic tac toe program.

We don't know that, actually. Maybe GAI isn't one shining simple algo, but cobbling together a bunch of algorithms like this one.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by exDM69 on Wednesday March 09, 2016 @05:35AM (#11252098)
It's only been the first round and I'm not throwing in the towel yet. Unlike AlphaGo, Lee Sedol has an opportunity to learn from their opponents since AlphaGo takes about 30 days of wall clock time to train the networks. There will be 5 games during the next week.

Despite my optimism, the writing is on the wall. AlphaGo and algorithms like it will only improve as you throw more CPU time at them. I actually want Lee Sedol to win, not because it would uphold some kind of human supremacy but because I want to see the AI guys put some more effort (and CPU time) into it. It would be a real shame if they'd win on their first attempt.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by panic on Wednesday March 09, 2016 @02:58AM (#11251560)
DeepMind is an algorithm which clearly improves a lot on traditional tree search. But how will a better tree search algorithm lead to AI taking over? Why does winning at Go mean AI is closer to taking over the world than when it won at Chess?
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Eliezer on Wednesday March 09, 2016 @03:03AM (#11251579)
It's not an improved tree search. Deepmind was almost pro level purely using the deep learning network before doing any Monte Carlo search.

One way of looking at the significance of this is that it might tell us that relatively simple machine learning algorithms can capture key aspects of the versatile human cortical capacity to learn things like Go using sheer pattern recognition. (It's amazing that human visual cortex can do that.) If the human brain were more mystical in its power, then human-level ability to recognize Go patterns wouldn't have been penetrable at all to a comparatively simple neural algorithm like deep learning.

From another standpoint, this could show that we're reaching the point where, when an AI algorithm starts to reach interesting levels of performance, a much-encouraged Google dumps 100,000 tons of GPU time and 5 months of a few dozen researchers' time to improve the algorithm right past the human performance level. In N years from now when it's a more interesting AI system doing more interesting cognition, we could see a more interesting result materialize when a big organization, encouraged by some key milestone, invests 5 months of time and massively more computing power to further improve an AI system.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by panic on Wednesday March 09, 2016 @03:06AM (#11251593)
Regardless of how good the deep learning network is on its own, the algorithm described in the DeepMind paper is an improved tree search.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by brian_cloutier on Wednesday March 09, 2016 @03:26AM (#11251669)
Forest for the trees.

Monte Carlo Tree Search was necessary and itself a massive improvement over minimax but not sufficient for creating a Go program to challenge professional players. The true innovation here is the neural networks. Without those networks to guide it AlphaGo plays far worse than existing programs.

The fact that those networks are sufficient is pretty incredible. We already knew that by inventing them we had created a very pure form of pattern recognition, but it's surprising that the pattern recognition coupled with some tree search seems to be all you need to play Go as well as humans.

It's not impressive to you that we've now reproduced a piece of human intelligence, "intuition", which was previously considered out of reach?

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by nazka on Wednesday March 09, 2016 @07:02AM (#11252427)
> but it's surprising that the pattern recognition coupled with some tree search seems to be all you need to play Go as well as humans.

Is it really all we need? Or it is more that they threw a lot of hardware to it? What if if a part of its efficiency is because they threw a lot of GPUs with a huge network, rather than having a NN efficient by itself?

We see that: "AlphaGos Elo when it beat Fan Hui was 3140 using 1202 CPUs and 176 GPUs. Lee Sedol has an equivalent Elo to 3515 on the same scale (Elos on different scales aren't directly comparable). For each doubling of computer resources AlphaGo gains about 60 points of Elo."

It's a lot of hardware.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by javierluraschi on Wednesday March 09, 2016 @11:28AM (#11253854)
What does a lot of hardware means? The human brain has about 100B neurons with about 100+ dendrites per neuron, while AlphaGo has about 1K CPUs with about 2B transistors per CPU.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by nazka on Wednesday March 09, 2016 @01:25PM (#11254672)
I am wondering how much the amount of hardware they used had an effect on the bottom line, compared to the wisdom of their algorithm. Everybody knows it's a great step in AI. But how much? How much their algorithm is smart? Or simply put did they overfit by throwing a lot of layers and GPUs to the task? Or the algorithm is truly smart? What is the ratio of that.

It is the same question for the data they used. Facebook, Google and others seem to agree that, at the end, the quantity and quality of data are more important than the algorithm itself. So how much is it at play here? Knowing that will be able to show us why it is performing well and how much we can appreciate their work.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by javierluraschi on Wednesday March 09, 2016 @05:18PM (#11256111)
You can take a look at their paper... http://airesearch.com/wp-content/uploads/2016/01/deepmind-ma...

Basically, the ("lots of hardware") distributed implementation gets ~3100 points in the Elo rating against ~2900. ~2900 is still sufficient to win against Fan Hui. So I would say, that yes, this algorithm has most of the merit here.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by panic on Wednesday March 09, 2016 @03:33AM (#11251695)
It's totally impressive! I'm excited for the future of DeepMind and to see what other kinds of things we can build from neural networks. I'm just saying that we have to be careful with what kind of intelligence we ascribe to an algorithm like this. An AI is not going to take over the world by impressing us with its game-playing skills.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by JabavuAdams on Wednesday March 09, 2016 @07:54AM (#11252656)
> An AI is not going to take over the world by impressing us with its game-playing skills.

What if you train an AI to play an RTS where matter, energy, and time are the resources and the goal is to take over the world?

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @08:55AM (#11252936)
I'm not going to fear an AI whose idea of "the world" is a computer game, an AI that isn't even aware of the existence of the real world, and isn't even aware of the existence of the set of real world actions.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by PascalsMugger on Wednesday March 09, 2016 @10:14AM (#11253391)
I think, almost by definition, you won't be afraid of anything until it's already coming for you. By that time it will already have the capability to decide your future.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:29PM (#11255865)
The thing is you are essentially making an unfalsifiable argument, invoking the existence of something that is merely imaginary.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by JabavuAdams on Wednesday March 09, 2016 @11:10AM (#11253744)
I should have put "RTS" in quotes. I'm referring to the real world -- the original RTS.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by nl on Wednesday March 09, 2016 @06:15AM (#11252245)
DeepMind is the company/lab Google bought. The algorithm is more properly called AlphaGo.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by taneq on Wednesday March 09, 2016 @05:14AM (#11252030)
> Forest for the trees.

Heh, nice one.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Eliezer on Wednesday March 09, 2016 @03:11AM (#11251616)
I don't think it's accurate to call AlphaGo 'improved tree search' the way that Deep Blue was improved tree search. You could with equal justice call it an improved neural net.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @03:16AM (#11251630)
The correct characterization is that it's a hybrid of deep learning and tree search. It's also a hybrid in the feature representation for the algorithm. There are raw features (board state), but there are also handcrafted features for the tree search.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by panic on Wednesday March 09, 2016 @03:20AM (#11251641)
I'd say both characterizations are accurate. Neither the tree search nor the neural net could have accomplished this on their own. But the essential interface to the algorithm is the tree search: it's picking the best move from a set of legal moves determined by formal game rules. The real world doesn't follow formal game rules. I find it difficult to see the progression from this victory to some kind of real-world AI takeover.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by kqr on Wednesday March 09, 2016 @06:30AM (#11252290)
Sure, but when you say "tree search" people think of the traditional kind of expert system-based tree search. Traditional tree search methods prune trees by approximating subtrees according to some very specific rules decided on by human experts. This means in a tree search system, the computer cannot actually evaluate a position any better than the humans that designed it. The way it performs better is by running very many of these evaluations deep down in the tree.

When you're talking about some other kind of evaluation function, such as Monte Carlo rollouts, you usually prefix that to the tree search (in the case of Monte Carlo rollouts, "Monte Carlo tree search" or MCTS) to indicate that besides the basic fundamental task common to almost all AIs (finding the optimal branches in a decision tree) it functions completely differently from the expert systems.

So is the case with this program, which (in a first pass) approximates subtrees by a trained neural net, rather than Monte Carlo rollouts or an expert system. So using terminology that suggests classical expert system tree search is bound to cause confusion (as you noticed).

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by igravious on Wednesday March 09, 2016 @03:57AM (#11251764)
> The real world doesn't follow formal game rules.

Really?

Why not?

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:18AM (#11251847)
Infinite state/belief/world space. Infinite action space. It's not so much that there aren't rules (there are - physics), it's that the complexity of the full set of rules is exponential or super-exponential.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by ogrisel on Wednesday March 09, 2016 @04:45AM (#11251937)
You can do math with continuous and infinite dimensional spaces.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @05:19AM (#11252052)
And? This does not address my argument that the complexity is beyond-combinatorially explosive (infinite spaces). I'm not talking about the space of possible board states. I'm talking about merely the set of all possible actions.

EDIT: clarified my language to address below reply.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by ogrisel on Wednesday March 09, 2016 @03:26PM (#11255509)
...and it's possible to train learning agents to sense and interact with a world described by high dimensional continuous vector spaces, for instance using conv nets (for sensing audio / video signals) and actor-critic to learn an continuous policy:

http://arxiv.org/abs/1509.02971

The fact that the (reinforcement) learning problem is hard or not is not directly related to whether the observation and action spaces are discrete or continuous.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by ogrisel on Wednesday March 09, 2016 @03:28PM (#11255514)
see also by the same team:

http://arxiv.org/abs/1602.01783

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:30PM (#11255872)
There is a near infinite number of such spaces.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by ogrisel on Thursday March 10, 2016 @03:57AM (#11258035)
I don't understand why would the "number of spaces" matters. What matters is can you design a learning algorithm that performs well in interesting spaces such as:

- discrete spaces such as atari games and go, - continuous spaces such as driving a car, controlling a robot or bid on a ad exchange.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Thursday March 10, 2016 @07:17AM (#11258721)
A really really large number of distinct decisions that need to be made. A car only needs to control a small set of actions (wheels, engine, a couple others I'm missing). A game player only needs to choose from a small set of actions (e.g. place piece at position X, move left/right/up/down/jump).
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by ogrisel on Thursday March 10, 2016 @08:34AM (#11259053)
A human brain also has a limited number of muscles to control to interact with the world.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Friday March 11, 2016 @07:57AM (#11266313)
And a much larger set of decisions.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by eru on Wednesday March 09, 2016 @06:19AM (#11252258)
Go is combinatorially explosive, too.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by vlowther on Wednesday March 09, 2016 @11:33AM (#11253905)
Your assertion that the universe has infinite anything is a common mistake. A stupidly large number of states is not infinite.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by zodiac on Wednesday March 09, 2016 @04:06AM (#11251808)
Well, by that logic, why can't you describe Lee Sedol as applying an "improved tree search" that happens to have really good move selection heuristics and static board evaluation function as well? After all, all good human Go players read ahead a few moves.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by 21 on Wednesday March 09, 2016 @03:01AM (#11251570)
The issue is that we don't take the threat seriously, since we believe we have plenty of time to solve it. Some don't even believe it's a threat at all (will unplug it, right?)

This 10 years to beat go prediction shows that our time estimates are wildly ignorant.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by kevinwang on Wednesday March 09, 2016 @03:03AM (#11251577)
ah, but it's not just tree search. It uses neural nets, which makes it different than the chess algorithms.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by chipsy on Wednesday March 09, 2016 @03:04AM (#11251584)
It isn't a tree search algorithm.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by typeformer on Wednesday March 09, 2016 @03:06AM (#11251591)
@panic I'm sorry but you don't understand go.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by lovemenot on Wednesday March 09, 2016 @03:33AM (#11251696)
This reinforces what a bad idea it is to drink and post.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by onion2k on Wednesday March 09, 2016 @03:08AM (#11251603)
Yet people will still tell that worrying about AI taking over is like worrying about overpopulation on Mars, and that this is a problem at least 50 years out.

As hard as writing AI for a problem space like "how to win at Go" is, it's several orders of magnitude easier than creating a general AI with the self-awareness required to see us as a threat.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Wednesday March 09, 2016 @04:07AM (#11251810)
There is a lot of progress being made in AI right now. Hard problems that were expected to take decades, are being beaten regularly. Who is to say how much AI could advance in the next 20-30 years? Do you really believe there's less than a 50% chance strong AI won't be invented in your lifetime?
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by onion2k on Wednesday March 09, 2016 @06:10AM (#11252221)
There is a lot of progress being made in AI right now. Hard problems that were expected to take decades, are being beaten regularly. Who is to say how much AI could advance in the next 20-30 years?

"We've beaten some hard problems more quickly than expected therefore we'll likely beat other hard problems more quickly than expected" is logical induction. It's equivalent to "I just flipped a coin and got heads. I'll probably get heads again on the next flip." Don't do that. :)

Do you really believe there's less than a 50% chance strong AI won't be invented in your lifetime?

I don't know. I don't really see the value in speculating.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Wednesday March 09, 2016 @02:02PM (#11254958)
>I just flipped a coin and got heads. I'll probably get heads again on the next flip

Which is corrrect, if you don't know the true probability of flipping heads. You might find, for example, that it's a trick coin with two heads and no tails.

You absolutely can predict future progress from past progress. E.g. Moore's law held true for decades after the observation was made. If you see a technology advancing rapidly, then there is no reason to say it will stop in the near future!

>I don't really see the value in speculating.

Because everything depends on this prediction. The invention of AI will be the most significant event in the history of humanity. It will totally change the world. Or likely, destroy it. Being prepared for it is absolutely necessary.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:31PM (#11255875)
No, not if you have a strong prior belief that coins in general are fair.

By your logic, you can predict the failure of AGI predictions by past failures of (every) AGI prediction.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Houshalter on Thursday March 10, 2016 @02:44PM (#11261690)
>No, not if you have a strong prior belief

Why would you have a strong prior belief about the invention of AGI? Now you are claiming to have far more certainty than I am.

>By your logic, you can predict the failure of AGI predictions by past failures of (every) AGI prediction.

This logic is extremely flawed. First not every prediction was wrong. Many people predicted it would happen in 2045, a few in 2030.

Second there's no reason past predictions represent the accuracy of future predictions about the same thing. Predictions should get more accurate over time, and early predictions are expected to be wildly wrong.

And third there's anthropic bias. If they were right, then we wouldn't be here to speculate about it. We can only ever observe negative outcomes, therefore observing a negative outcome shouldn't update your priors at all.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Friday March 11, 2016 @07:53AM (#11266294)
I was refuting your coin argument, which was pretty ridiculous, if I do say so.

The vast majority of predictions were wrong.

Yes, the logic is flawed, that's why I said it was your logic.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by pixl97 on Wednesday March 09, 2016 @10:16AM (#11253402)
>I don't really see the value in speculating.

There is all kinds of value in speculating. We do it all the time in things like war games. 'If neighbor $x attacked us, what would happen?, would they win?, what can we do to prevent this?'.

Of course this may in your mind hold very little value now, but I promise if and when it occurs you will change your mind quickly on that topic.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by PascalsMugger on Wednesday March 09, 2016 @10:25AM (#11253463)
Do you think it's better to propose we won't, and not start preparing for a smarter-than-human intelligence. Or to propose we might, and that we should prepare for it to happen?
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by onion2k on Wednesday March 09, 2016 @11:20AM (#11253811)
On the face of it we should definitely have a strategy for dealing with strong AI, but with no knowledge of what strong AI will look like how would we prepare for it? There's ostensibly nothing we can do. Until we make more progress in the field we can't make any preparations other than wild speculation. And that is what I see no value in.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by CamperBob2 on Wednesday March 09, 2016 @03:22AM (#11251648)
The interesting thing is that this algorithm taught itself to master the game. If you're writing a chess engine, you just "write the AI for the problem space" in a few dozen lines of code, as you put it, and let brute force do the rest. In the case of DeepMind, faced with a game where a traversal approach is numerically impossible, its programmers gave it the ability to improve by playing against itself.

That's the difference between a neural net -- which until about an hour ago was a phrase that reliably set off my snake-oil detector -- and a simple tree search. DeepMind just beat a Go master... and nobody can say exactly how it did it.

That's a big deal.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by riffraff on Wednesday March 09, 2016 @03:30AM (#11251685)
it is a big deal, but it is still very different from general AI, and we are very good at underestimating complexity.

Remember that "solve computer vision" was considered a summer project.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by faizshah on Wednesday March 09, 2016 @03:34AM (#11251702)
I think it's the same as what happened when the perceptron was the big thing in the 50s/60s. Many made far overreaching conclusions about how the problem of AI had been solved.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by CamperBob2 on Wednesday March 09, 2016 @02:00PM (#11254946)
Remember that "solve computer vision" was considered a summer project.

And they're pretty much there. Have you seen some of the latest results in that field?

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by riffraff on Wednesday March 09, 2016 @02:59PM (#11255374)
I think you misunderstood, I am referring to the fact that Marvin Minsky in 1966, asked Gerald Sussman to "spend the summer linking a camera to a computer and getting the computer to describe what it saw".

We certainly got nearly there, but it was nearly 50 years later, not 3 months. Similarly, something that might look somewhat simple to us right now, might also be a lot more difficult.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by CamperBob2 on Wednesday March 09, 2016 @03:25PM (#11255503)
I see what you mean -- sorry, I thought you were referring to a Summer of Code project.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by zodiac on Wednesday March 09, 2016 @04:09AM (#11251817)
> its programmers gave it the ability to improve by playing against itself

Good chess programs definitely use self-play to improve themselves, eg to tune parameters and heuristics.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by CamperBob2 on Saturday March 12, 2016 @03:47PM (#11274480)
They don't invent moves that they weren't explicitly programmed to play, though, do they? People at the top level of play have been beaten by chess programs but not surprised by them, the way the Go professionals have been in this case. DeepBlue didn't teach us anything about chess that we didn't already know.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by pfisch on Wednesday March 09, 2016 @03:23AM (#11251655)
In other words, it could be created in the next 10 to 20 years.

We should be taking steps to outlaw black box algorithms right now but I'm sure we won't.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by pgodzin on Wednesday March 09, 2016 @04:53AM (#11251969)
How do you outlaw black box algorithms? What is a black box algorithm? Should we outlaw all calls to libraries we don't have the complete source code to?

I can't understand the call to regulate a technology when it is decades (much more that 10-20 years) away from possibly existing in a state that we can't even imagine. Add to that legislators with zero technical literacy. That's essentially advocating for shutting down all research into a technology that can improve millions of lives.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by pfisch on Monday March 14, 2016 @04:13AM (#11281601)
A black box algorithm is any algorithm that wasn't really written by a human. It isn't about having the source code, it is about utilizing the output of a neural network, which is built up by multiplying a bunch of inputs by weight values and is basically nonsense when you look at it.

Basically any algorithm where you are training it with tons of samples and then it creates a logic tree that is not written by a human is a black box algorithm.

By the time AI technology gets to the point that we realize we should regulate it we will be too late.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Teodolfo on Wednesday March 09, 2016 @03:01AM (#11251567)
Many of the people saying not to worry ALSO predicted AlphaGo. So let's not get ahead of ourselves.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Eliezer on Wednesday March 09, 2016 @03:29AM (#11251681)
[Citation needed.]

I for one did not say to not worry, and I bet $1500 vs. $2250 on Sedol winning the match before getting cold feet and arbing my outstanding bets down to $400 vs. $700.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by wrsh07 on Wednesday March 09, 2016 @10:48AM (#11253600)
Can't you just look at the creators of the program? Demis says he certainly does not worry about a "terminator" or "ex machina" style scenario and also predicted they would win: http://www.bbc.com/news/business-34266425

Beyond that, it seems reasonable to call for discussion about how AI is used [as he also does in that article].

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Eliezer on Wednesday March 09, 2016 @12:13PM (#11254171)
That is NOT Demis saying not to worry, it's him saying the Terminator movie is a bad model.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by _vk_ on Wednesday March 09, 2016 @12:55PM (#11254470)
>Demis says he certainly does not worry about a "terminator" or "ex machina" style scenario

Neither does the Friendly AI crowd.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by gjm11 on Wednesday March 09, 2016 @05:23AM (#11252064)
You are not a counterexample to Teodolfo's claim, which was about people who did say not to worry.

[EDITED to add:] Oh, I see, your point is that it looks like AlphaGo is doing better than an "AI moves fast" advocate expected, rather than (per Teodolfo) no better than some "AI moves slowly" advocates expected. Fair enough.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:21AM (#11251860)
Why does Teodolfo even need a citation for that? Are you really suggesting that there is no group of people who believe AI is not a threat to worry about, and believed that AlphaGo would win?
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by Eliezer on Wednesday March 09, 2016 @05:18AM (#11252050)
I'm sure there's someone on the planet. Which is a very different state of affairs from the one that would obtain if a well-known AI researcher had, say, made a $1500 public bet on AlphaGo winning, while also loudly declaring that worrying about AGI was like worrying about overpopulation on Mars, in the company of other researchers declaring similar combined expectations.

What actually happened was the reverse of that; AI moved faster than I publicly bet a large sum of money on it moving, and I was already worried before then.

I'm not aware of the reverse-reverse having happened.

If you're claiming something as a successful advance prediction to bolster belief in a general model, it's fair play to ask for a record of that advance prediction.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @06:52AM (#11252383)
Now you're moving the standard-of-citation-evidence goalposts ;)
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by davidiach on Wednesday March 09, 2016 @05:22AM (#11252060)
@Eliezer, but you might still win the bet, this was just the first match.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by YeGoblynQueenne on Wednesday March 09, 2016 @01:29PM (#11254706)
Go is literally infinitely more easy to solve than general intelligence. "Literally" in the sense that Go has a finite number of board states, while a general intelligence must be able to deal with an infinite amount of novel situations, presumably by generalising from previously experienced ones.

Infinity is a real problem. When you try to learn from examples, you first need to see "enough" examples of whatever you're trying to learn. If there are infinitely many such examples, no matter how clever you are in tackling your search space there will always be infinitely many examples of infinitely many situations you've never come across, and that you won't be able to learn.

The typical example of this is language. You could give a learner all phrases of a given language every produced and it would still be missing an infinite amount of necessary examples. Somehow (and it's freaky when you stop to think about it) humans get around this and we can produce and understand parts of infinity, without sweating it.

Machine learning is simply incapable of generalising like that and anyone who thinks AGI is just around the corner has just failed to consider what "general" really, really means.

Though to be fair, now that I had my little rant I have to admit that you don't need to go "general intelligence" before you can be really, really dangerous. Even if AI doesn't "take over" it can do a lot of damage, frex if we start using autonomous weapon systems or hand over critical infrastructure maintenance to limited and inflexible mechanical intelligence.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by escoz on Wednesday March 09, 2016 @02:57PM (#11255361)
Yes, go have a finite number of board states, just 2.08168199382×10^170, just a bit over the 10^80 atoms in the universe.

https://en.wikipedia.org/wiki/Go_and_mathematics

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by YeGoblynQueenne on Wednesday March 09, 2016 @07:35PM (#11256678)
Yes, but the point is that you 're not going to brute-force this. If it's finite you can hope to approximate it. If it's not finite, you can't even approximate it.

Look- take Monte Carlo methods. You can sample a very big number of events and hope to get some useful information from that. If you sample infinity, though, what do you get? Infinity.

Re:AlphaGo beats the world champion Lee Sedol in first of fi... by argonaut on Wednesday March 09, 2016 @04:33PM (#11255892)
Not all of those board states are "novel." The true "dimensionality" of "novel patterns" in Go is much smaller.
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by z0r on Wednesday March 09, 2016 @02:48PM (#11255300)
I was one of the people who rooted for the champion last month, and my position hasn't changed. Last night's game was very exciting, but if the pressure doesn't get to Sedol he has a chance. He made some mistakes in the game and AlphaGo played incredibly well. General opinion I've seen so far is that the lead switched hands in a few places, although I'm waiting for professional commentaries to illuminate what possibilities were there for both players - the played game is always just the tip of the iceberg
Re:AlphaGo beats the world champion Lee Sedol in first of fi... by tim333 on Wednesday March 09, 2016 @03:47AM (#11251734)
Some people may say AI being a worry is 50 years but not usually smart ones who know anything much about it.