Re:‘Artificial Intelligence’ Was the Fake News of 2016
by Eridrus on Monday January 02, 2017 @04:11PM
(#13304576)
There are two ways to interpret what Hinton says:
a) the algorithms are unimportant because all that we needed was computation
b) the algorithms were ahead of their time
I think that it is actually the latter that is true; in the same way that electricity was a precondition for computation. Babbage designed the difference engine and the analytical engine before they could realistically be implemented, this doesn't mean the design was unimportant.
AMT: Ok, so you have been working on neural networks for decades but it has only exploded in its application potential in the last few years, why is that?
Geoffrey Hinton: I think it’s mainly because of the amount of computation and the amount of data now around but it’s also partly because there have been some technical improvements in the algorithms. Particularly in the algorithms for doing unsupervised learning where you’re not told what the right answer is but the main thing is the computation and the amount of data.
The algorithms we had in the old days would have worked perfectly well if computers had been a million times faster and datasets had been a million times bigger but if we’d said that thirty years ago people would have just laughed.
As to the papers you mention- researchers publish papers and in them, they make claims. That's their job. The job of anyone who reads a paper is to take it in good faith but retain their critical and skeptical stance throughout. If you're not directly involved with ANN research, or implementing your own ANN systems for some commercial application, it's very hard to know whether a claim in a paper is useful to anyone besides the scientist who published it.
________________
[1] http://techjaw.com/2015/06/07/geoffrey-hinton-deep-learning-...