News for hackers. Stuff that matters.

A comment on Megatron-Turing NLG 530B, the World’s Largest Generative Language Model. Parent comment

Re:Megatron-Turing NLG 530B, the World’s Largest Generative ... by codeulike on Monday October 11, 2021 @02:12PM (#28831165)
Unless we have misunderstood neurons, and microtubules are the fundamental computational unit in which case we are out by an order of magnitude
[ Parent | on HN ]
Re:Megatron-Turing NLG 530B, the World’s Largest Generative ... by eximius on Monday October 11, 2021 @02:20PM (#28831239)
There was a result recently of modeling an organic neuron with 1000 digital neurons.

And even if that result was perfect modeling of the neuron, that assumes perfect and exhaustive data readings on the organic neuron, which is, frankly, unlikely. (Not that I know how to estimate how much it's missing, but I don't think we fully understand a single neuron yet.)

[ Parent | on HN ]