Re:The hippocampus as a 'predictive map'
by derefr on Tuesday October 03, 2017 @04:34PM
(#15395918)
Sure, but (our models of the functions of) neurotransmitters don't have that much to do with biology, either. For example, the local level of dopamine in a neuron is understood to be something like an encoding of a confidence interval associated with the computation, such that where synapses in the sensory (NMDA-excited) and model-predictive (AMPA-excited) regions of the brain come into contact, the dopamine in each region bubbles up as a bunch of coefficients that adjusts how comparisons between data and predictions shake out, temporarily biasing whether "branches" to error states (i.e. the activation of higher-layer neurons) are taken.
This works just as well whether you are modelling biological synapses with plasticity, or compositions of functions with training via backpropagation.
The only real difference is that NNs aren't usually "physically embodied" (i.e. embedded in a metric space with radiative signalling to non-connected but "local" neighbours) in the way they'd have to be to get the "area-effect excitation" effects of neurotransmission.
This works just as well whether you are modelling biological synapses with plasticity, or compositions of functions with training via backpropagation.
The only real difference is that NNs aren't usually "physically embodied" (i.e. embedded in a metric space with radiative signalling to non-connected but "local" neighbours) in the way they'd have to be to get the "area-effect excitation" effects of neurotransmission.