Re:Deep learning is hitting a wall?
by tasty_freeze on Wednesday March 09, 2022 @11:21PM
(#30623189)
Nope. I don't think anyone thinks the brain is an N layer deep network. There are many networks, and they cross-couple inputs and outputs from various subnetworks into others. There are also hormonal regulatory systems with feedback mechanisms that interact with these networks both is inputs and outputs. The brain is hugely more complicated and messy than anything that, say, GPT-3 is doing.
[ Parent
| on HN ]
I'd also add that the subconscious parts of the brain seem to function quite a bit differently from the conscious parts. It's hard to reason about something like "why does my eye see how it does" when those parts aren't consciously accessible.
Re:Deep learning is hitting a wall?
by 9wzYQbTYsAIc on Wednesday March 09, 2022 @11:25PM
(#30623209)
So Parallel Distributed Processing, it is?
Apparently deep learning has been beat-to-death as a word, but the way deep learning was explained to me, it is an approach not a specification.
Yeah, if you dilute the meaning down to “feedback loop”, then deep learning and the brain work the same way.
Re:Deep learning is hitting a wall?
by 9wzYQbTYsAIc on Wednesday March 09, 2022 @11:42PM
(#30623289)
I’m not sure that it is correct to limit deep learning to just a feedback loop, but cybernetics (if the thermostat variety, not the terminator variety) might be the right word.