Re:Theories of Error Back-Propagation in the Brain
by raindeer3 on Sunday August 11, 2019 @03:01AM
(#20666783)
Yes, but also in hebbian learning you must have some weakening of weights, otherwise the weights would just grow indefinitely? One example I guess is Oja's rule.
The difference to bp is just how to select what weights to strengthen and what to weaken based on what information. Forgetting and learning must always happen one way or the other. Or am I not getting your point?
Re:Theories of Error Back-Propagation in the Brain
by subroutine on Sunday August 11, 2019 @03:07AM
(#20666805)
I agree. Above I mention that neurons have finite resources so synaptic strength is essentially zero-sum. When a new set of synapses becomes strengthened, it implies that all the other synapses must be weakened by some amount.
Here is a nice animation of signal propagation in biological neural nets:
To simulate the dynamics of synaptic strength I created 3D mesh of a dendrite segment with several synapses...
Then I simulate the diffusion of AMPA receptors on the surface (the number of AMPAR in a synapse is proportional to its strength)...
I don't have animations of this process but you can imagine what happens when one synapse holds onto receptors longer than the others (has a reduced particle diffusion rate), when there are a finite number of receptors
Re:Theories of Error Back-Propagation in the Brain
by hos234 on Sunday August 11, 2019 @07:35AM
(#20667671)
Maybe Glial cells are playing a role - https://www.sciencedaily.com/releases/2018/06/180618222427.h...
Re:Theories of Error Back-Propagation in the Brain
by subroutine on Sunday August 11, 2019 @10:02AM
(#20668209)
> In cell culture studies, they added neurons to astrocytes that overexpressed ephrin-B1 and were able to see synapse removal, with the astrocytes "eating up" the synapses... "We think that astrocytes expressing too much of ephrin-B1 can attack neurons and remove synapses"
Yeah that would be a problem. Maybe Glial cells play a role, maybe they don't, opinions vary. https://streamable.com/1vi7r
Here is a good article explaining not just in theory how LTP (long term potentiation) works in neurons but why a particular protocol always works irl (I can attest to the validity of these statements based on first hand experience):
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3843869/
To summarize, the most reliable way to induce LTP is to "take control of the postsynaptic membrane with intracellular Cs+ to block K+ channels, which allows the experimenter to hold the cell at a constant membrane potential and induce a minimal ‘pairing’ protocol to induce LTP: depolarizing the cell to 0 mV while stimulating synapses."
Holding the cell at 0 mV ensures Mg is always ejected, so any upstream stimulation will always be seen as a coincidence.