News for hackers. Stuff that matters.
Re:Computer scientists prove why bigger neural networks do b... by mattkrause on Thursday February 10, 2022 @04:07PM (#30292545)
An individual biological neuron can compute a variety of functions, including max and xor, that a single perceptron can't (e.g., https://www.science.org/doi/10.1126/science.aax6239 ). In general, one needs a fairly elaborate ANN to approximate the behavior of a single biological neuron.

OTOH, a three-layer network is a universal function approximator and RNNs are universal dynamical systems approximators, so they are sort of trivially equivalent.

There are no comments on this comment yet.