Re:What are the limits of deep learning?
by mettamage on Wednesday January 23, 2019 @02:51PM
(#18982032)
Hobbyist here as well.
> As far as I know of (and I could be wrong) - there has yet to be any kind of proven method that the human brain uses any form of back-propagation for learning. From what I understand, there isn't a biological equivalent.
Is there research done on how individual or a small group of neurons learn?
> We also seem to learn things faster; natural neural networks - brains - regardless of species - only require relatively few examples to learn and generalize from, while deep learning artificial neural networks require thousands and more, of labeled examples.
When you take the point of your parent's post, then I'd assume having multiple neural nets learning at the same time and seeing things from different perspectives then we might get there as well.
> We haven't even created the equivalent of a mouse brain, and if we did, it would take the energy output of Niagara Falls to run it.
Our brain is specialized architecture. Emulating a brain on a Von Neumann machine designed computer is similar to a brain trying to emulate a computer. To me it makes sense that you'd need specialized hardware for this.
I wonder if we could simulate a neural net of a simple creature, like a worm.
> As far as I know of (and I could be wrong) - there has yet to be any kind of proven method that the human brain uses any form of back-propagation for learning. From what I understand, there isn't a biological equivalent.
Is there research done on how individual or a small group of neurons learn?
> We also seem to learn things faster; natural neural networks - brains - regardless of species - only require relatively few examples to learn and generalize from, while deep learning artificial neural networks require thousands and more, of labeled examples.
When you take the point of your parent's post, then I'd assume having multiple neural nets learning at the same time and seeing things from different perspectives then we might get there as well.
> We haven't even created the equivalent of a mouse brain, and if we did, it would take the energy output of Niagara Falls to run it.
Our brain is specialized architecture. Emulating a brain on a Von Neumann machine designed computer is similar to a brain trying to emulate a computer. To me it makes sense that you'd need specialized hardware for this.
I wonder if we could simulate a neural net of a simple creature, like a worm.