Re:Theories of Error Back-Propagation in the Brain
by marmaduke on Sunday August 11, 2019 @06:55AM
(#20667533)
It was interesting to read how you did a spiking eural network in PyTorch, but it seems your neurons' states are coupled continuously in time, whereas in the brain, it would be the opposite, ie. the spike timing carries information and not the state values.
> backprop engenders STDP
This is backwards I think, but definitely an interesting association to make
Re:Theories of Error Back-Propagation in the Brain
by codekansas on Sunday August 11, 2019 @09:23AM
(#20668057)
There's a cool package called Nengo from Chris Eliasmith's group at UWaterloo which hasn't received as much attention as I think it should: https://www.nengo.ai/nengo-dl/examples/tensorflow-models.htm...
Re:Theories of Error Back-Propagation in the Brain
by etiam on Sunday August 11, 2019 @03:37PM
(#20669971)
You may be interested to watch this talk:
http://www.cs.nyu.edu/~yann/deep07/videos/mov010.avi
Slides: http://www.cs.toronto.edu/~hinton/backpropincortex2007.pdf
- I got something for that, in fact I think I discovered that backpropagation engenders STDP:
https://github.com/guillaume-chevalier/Spiking-Neural-Networ...