Re:AlphaGo beats the world champion Lee Sedol in first of fi...
by eru on Wednesday March 09, 2016 @06:14AM
(#11252240)
Dropout (and maxout) might also count.
Re:AlphaGo beats the world champion Lee Sedol in first of fi...
by fma on Wednesday March 09, 2016 @07:58AM
(#11252676)
It's only difficult because no one threw money at it. It's like saying going to Mars is difficult. It is - but most of the technology is there already, just need money to improve what was used to go to the moon.
If you asked people 10 years ago before the moon landing if it was possible, I too would agree it's impossible. But after that breakthrough it opened up the realm is possibilities.
I see AlphaGo more of an incremental improvement than a breakthrough.
Re:AlphaGo beats the world champion Lee Sedol in first of fi...
by oldmanjay on Wednesday March 09, 2016 @05:55PM
(#11256296)
It's a basic human bias to believe that anything that you don't have to do (or know how to do) "just needs money" to get done.
Re:AlphaGo beats the world champion Lee Sedol in first of fi...
by nl on Wednesday March 09, 2016 @10:50PM
(#11257290)
So are you arguing that superhuman-level performance in just a matter of engineering effort? Or am I missing something?
I'm generally considered to be way over optimistic in my assessment of AI progress. But wow.. that's pretty optimistic!
10 years ago no one believed it was possible to train deep nets[1].
It wasn't until the current "revolution" that people learned how important parameter initialization was. Sure, it's not a new algorithm, but it made the problem tractable.
So far as algorithmic innovations go, there's always ReLU (2011) and leaky ReLU (2014). The one-weird-trick paper was pretty important too.
[1] Training deep multi-layered neural networks is known to be hard. The standard learning strategy— consisting of randomly initializing the weights of the network and applying gradient descent using backpropagation—is known empirically to find poor solutions for networks with 3 or more hidden layers. As this is a negative result, it has not been much reported in the machine learning literature. For that reason, artificial neural networks have been limited to one or two hidden layers
http://deeplearning.cs.cmu.edu/pdfs/1111/jmlr10_larochelle.p...