we know the brain does not use gradient descent. (i agree it doesn't matter)
Re:"They're made out of weights"
by anthonyrstevens on Thursday June 04, 2026 @09:42AM
(#48398536)
How do we know this?
i recall a hinton lecture where he talks about the mechanism of memory formation in the brain and it's not fully sussed out but it's also not backprop, its some sort of forward prediction and immediate reinforcement loop.
There's also no plausible biological/chemical mechanism to backpropagate.
It's good that it doesn't matter. Stochastic gradient descent works (or doesn't work) regardless of whether we know how the brain does its thing.