What are the limits of deep learning?

Re:What are the limits of deep learning? by YeGoblynQueenne on Wednesday January 23, 2019 @04:20PM (#18983088)

>> And it could make the networks far less vulnerable to adversarial attacks simply because a system that represents things as objects, as opposed to patterns of pixels, isn’t going to be so easily thrown off by a little noise or an extraneous sticker.

But, representing objects and their relations is how Good, Old-Fashioned AI works and the inability to deal with noisy input was, exactly, where GOFAI systems stumbled. How are relational representations going to suddendly help neural nets (famously robust to noise already) better handle noise?

In any case, if we really want to learn relations there are symbolic learning techniques that can do that very cheaply from very few examples. Are we reinventing the wheel, only with more artificial neurons, now? And what's the point of that?

[ Parent | on HN ]

Re:What are the limits of deep learning? by AstralStorm on Thursday January 24, 2019 @04:39AM (#18987241)

The problem is that neither AI can differentiate between something new and noise. Even probabilistic models have this problem to a lesser degree. So the idea is indeed to have an ANN learn a kind of a semantic network - then the problem is still pruning it and clustering reliably as well as detecting the new.

[ Parent | on HN ]