News for hackers. Stuff that matters.
Re:There's No Fire Alarm for Artificial General Intelligence by 196883 on Saturday October 14, 2017 @03:16PM (#15473716)
While part of me agrees with your analysis, I'd like to point out what I think could make this wave of ML/AI more serious. You are absolutely correct that deep learning is not very biologically accurate and that what today's models do seems a long way from AGI. However, in my opinion, the most fundamental aspect of intelligence is the ability to form useful abstract ideas to model reality. To make that more concrete, as a rather extreme example, consider the invention of numbers. The process by which people developed the notion of abstract quantity separated from any particular real experience is, to me, the most archetypal example of what it means to be intelligent. Of course, deep learning can't invent abstract math, but it seems to be able to mimic this process in a very rudimentary way. It's not a faithful representation of real neural networks, but perhaps it has just enough of the right ingredients, scale, depth, non-linearity, hierarchy, such that it is able to demonstrate a spark of that magic, hard-to-define process of intelligence. When a deep net learns MNIST, it seems to come up with an abstract notion of what a handwritten 9 looks like and it's hard to argue that there isn't something very mysterious and special happening.
Re:There's No Fire Alarm for Artificial General Intelligence by argonaut on Saturday October 14, 2017 @05:39PM (#15474469)
Your example actually runs counter to the idea that we're seeing a massive breakthrough. Deep nets on MNIST for recognizing numbers were done 20 years ago.
Re:There's No Fire Alarm for Artificial General Intelligence by randomsearch on Saturday October 14, 2017 @03:53PM (#15473874)
> it seems to come up with an abstract notion of what a handwritten 9 looks like

It does indeed - it comes up with features that indicate what a handwritten 9 looks like. But it doesn't develop the concept of what 9 _is_. It doesn't say "well, that's a concept I can apply to lots of places. Hey, I wonder what nine nines look like!" It's doing pattern recognition on pixels, which is cool and no doubt what we do to some extent, but it doesn't have that higher level of reasoning.