Re:Alice's adventures in a differentiable wonderland
by kragen on Tuesday April 30, 2024 @04:16PM
(#40215780)
anns originated in hypotheses about how neurobiology might work in the 01940s but diverged completely from neurobiology in the 01960s; they contain nothing we've learned about neurons in the last 50 years, and not much from before that either (they don't, for example, do hebbian learning). current anns use training methods like gradient descent with momentum and activation functions like relu which have no plausible biological realization
artificial neural networks are an approximation of biological neural networks in the same way that a submarine is an approximation of a fish
artificial neural networks are an approximation of biological neural networks in the same way that a submarine is an approximation of a fish