Re:Google Open-Sources Trillion-Parameter AI Language Model ...
by qayxc on Thursday February 18, 2021 @04:44AM
(#26177875)
> If every synapse was equivalent to just one parameter in ANN, then we could be just magic memoization machines.
It's a poor comparison, though, since neurons and synapses aren't the same as parameters in a computational network. It's the same trap that news outlets routinely fall into when citing "storage capacity of the brain" in TBs and other such nonsense.
It's a poor comparison, though, since neurons and synapses aren't the same as parameters in a computational network. It's the same trap that news outlets routinely fall into when citing "storage capacity of the brain" in TBs and other such nonsense.