Re:Theories of Error Back-Propagation in the Brain
by raindeer3 on Sunday August 11, 2019 @03:01AM
(#20666783)
Yes, but also in hebbian learning you must have some weakening of weights, otherwise the weights would just grow indefinitely? One example I guess is Oja's rule.
The difference to bp is just how to select what weights to strengthen and what to weaken based on what information. Forgetting and learning must always happen one way or the other. Or am I not getting your point?
[ Parent
| on HN ]
Re:Theories of Error Back-Propagation in the Brain
by subroutine on Sunday August 11, 2019 @03:07AM
(#20666805)
I agree. Above I mention that neurons have finite resources so synaptic strength is essentially zero-sum. When a new set of synapses becomes strengthened, it implies that all the other synapses must be weakened by some amount.
Here is a nice animation of signal propagation in biological neural nets:
To simulate the dynamics of synaptic strength I created 3D mesh of a dendrite segment with several synapses...
Then I simulate the diffusion of AMPA receptors on the surface (the number of AMPAR in a synapse is proportional to its strength)...
I don't have animations of this process but you can imagine what happens when one synapse holds onto receptors longer than the others (has a reduced particle diffusion rate), when there are a finite number of receptors
Re:Theories of Error Back-Propagation in the Brain
by hos234 on Sunday August 11, 2019 @07:35AM
(#20667671)
Maybe Glial cells are playing a role - https://www.sciencedaily.com/releases/2018/06/180618222427.h...
Re:Theories of Error Back-Propagation in the Brain
by subroutine on Sunday August 11, 2019 @10:02AM
(#20668209)
> In cell culture studies, they added neurons to astrocytes that overexpressed ephrin-B1 and were able to see synapse removal, with the astrocytes "eating up" the synapses... "We think that astrocytes expressing too much of ephrin-B1 can attack neurons and remove synapses"
Yeah that would be a problem. Maybe Glial cells play a role, maybe they don't, opinions vary. https://streamable.com/1vi7r