Re:The Fourier transform is a neural network
by etienne618 on Thursday April 29, 2021 @12:28PM
(#26983191)
It seems that backpropagation might be a good abstraction for biological learing rules after all: "local predictive coding converges asymptotically (and in practice rapidly) to exact backprop gradients on arbitrary computation graphs using only local learning rules" from https://arxiv.org/abs/2006.04182
Re:The Fourier transform is a neural network
by 29athrowaway on Thursday April 29, 2021 @09:14PM
(#26988836)
In biology there are excitatory networks and inhibitory networks.
Re:The Fourier transform is a neural network
by cl3misch on Thursday April 29, 2021 @09:18AM
(#26980766)
Isn't "backpropagation" just a synonym for the partial derivative of the scalar cost function with respect to the weights? And in the mathematical formulation of biological neural networks these derivatives can't be computed analytically. Your comment sounds like "backpropagation" is some kind of natural phenomenon.
Re:The Fourier transform is a neural network
by 29athrowaway on Thursday April 29, 2021 @10:30AM
(#26981630)
> Your comment sounds like "backpropagation" is some kind of natural phenomenon.
No it's not, read again.
Re:The Fourier transform is a neural network
by ta988 on Thursday April 29, 2021 @09:36AM
(#26980962)
Not exactly the same kind of backpropagation but signals fly the other way in neurons as well https://en.wikipedia.org/wiki/Neural_backpropagation
Backpropagation is a placeholder for stuff we don't understand.