News for hackers. Stuff that matters.
Re:Jamba: Production-grade Mamba-based AI model by imtringued on Friday March 29, 2024 @03:37AM (#39861527)
People don't understand that to simulate a single neuron, you need an entire neural network. So 70 billion parameters might at best be equivalent to a million neurons but that is assuming that your neural network architecture is akin to the connections between neurons. Considering the physical sparsity, you might need even more parameters to model the connections of a biological neural network. So less than a million neurons in practice.

There are no comments on this comment yet.