News for hackers. Stuff that matters.
Re:The Limitations of Deep Learning by kowdermeister on Monday July 17, 2017 @04:51PM (#14792167)
> In short, deep learning models do not have any understanding of their input, at least not in any human sense. Our own understanding of images, sounds, and language, is grounded in our sensorimotor experience as humans—as embodied earthly creatures.

Well maybe we should train systems with all our sensory inputs first, like newborns leans about the world. Then make these models available open source like we release operating systems so others can build on top of that.

For example we have ImageNet, but we don't have WalkNet, TasteNet, TouchNet, SmellNet, HearNet... or other extremely detailed sensory data recorded for an extended time. And these should be connected to match the experiences. At least I have no idea they are out there :)

Re:The Limitations of Deep Learning by jonobelotti on Monday July 17, 2017 @07:07PM (#14793044)
Brooks' 'Intelligence Without Representation' (http://people.csail.mit.edu/brooks/papers/representation.pdf) starts with a pretty strong argument imo against the story of 'stick-together' AGI you're describing.
Re:The Limitations of Deep Learning by randcraw on Tuesday July 18, 2017 @04:56PM (#14800004)
I think Brooks' Cog initiative was an attempt to 'ground' the robot's perceptions of the physical world into forming a rich scalable representation model. But it looks like that line of investigation ended ~2003 with Brooks' retirement. Too bad, given the seeming suitability of using deep nets to implement it.

http://www.ai.mit.edu/projects/humanoid-robotics-group/cog/o...

Re:The Limitations of Deep Learning by webmaven on Monday July 17, 2017 @08:17PM (#14793397)
Thanks for the link to this interesting paper.

I think we're seeing some recapitulation of those arguments WRT 'ensembles of DL models' approaches.

Re:The Limitations of Deep Learning by thundergolfer on Monday July 17, 2017 @10:03PM (#14793826)
I agree. Google has come out with some papers that are, to put it harshly, basic gluing together of DL models followed by loads of training on their compute resources.
Re:The Limitations of Deep Learning by webmaven on Monday July 17, 2017 @11:27PM (#14794084)
Not just Google. The FractalNet paper comes to mind.
Re:The Limitations of Deep Learning by reckoner2 on Monday July 17, 2017 @05:12PM (#14792304)
This approach has always interested me. I can train an decent Cats Vs. Dogs classifier in a few minutes. But real human intelligence takes many years of continuous and varied input to develop.

Are there systems out there that are taking influence from newborns being exposed to the world? An unsupervised learning system with a huge array of inputs running for years?

Re:The Limitations of Deep Learning by kowdermeister on Monday July 17, 2017 @05:37PM (#14792478)
All these current examples of AI and ML are just a very small fraction of what we mean by intelligence so I'm not surprised by the pessimistic posts that hit HN from time to time.

Training systems with rich real world experiences sounds something that Open AI should be developing. It's probably not something that you can do over a weekend plus it takes serious of funding and wetware so it's probably the reason it's not there yet.

Re:The Limitations of Deep Learning by folksinger on Monday July 17, 2017 @06:49PM (#14792920)
See: Kant on a priori notions of space-time.