News for hackers. Stuff that matters.
Re:'Human brain' supercomputer with 1M processors switched o... by JoeAltmaier on Monday November 05, 2018 @10:38AM (#18383094)
Does that add up? Doesn't the human brain have several more zeroes on there? Maybe 'worm brain' or 'lizard brain' would be a better description?
Re:'Human brain' supercomputer with 1M processors switched o... by delecti on Monday November 05, 2018 @10:48AM (#18383198)
It's about 100B neurons in a human brain [0], but neurons are also much slower. Individual neurons run at under 200Hz [1], which is probably a half dozen orders of magnitude lower than these processors are running at. Maybe it balances out?

[0] https://www.verywellmind.com/how-many-neurons-are-in-the-bra... [1] https://en.wikipedia.org/wiki/Neural_oscillation

Re:'Human brain' supercomputer with 1M processors switched o... by Retric on Monday November 05, 2018 @10:51AM (#18383237)
Neurons do a lot more than 1 calculation for each of those Hz.

Dendritic branching can be extensive and in some cases is sufficient to receive as many as 100,000 inputs to a single neuron. https://en.wikipedia.org/wiki/Dendrite

A more conservative 10,000 * 200 Hz ~= 2 Mhz * 100B ~= 100 Million 2 Ghz processors cores.

Though each dendrite is again doing far more than one calculation per each of those cycles.

Re:'Human brain' supercomputer with 1M processors switched o... by delecti on Monday November 05, 2018 @01:19PM (#18384561)
While true, the same is also true for many processor architectures. They're not just doing a single mathematical calculation per cycle, and additionally they also take multiple bits of input. A 32 bit processor could be thought of as having 32 "dendrites" of input, depending on what specific calculations are being performed to emulate the functions of neurons.

I recognize that the specifics are very different between a single neuron and a single processor, but the processors are so much faster that I'm inclined to give some benefit of the doubt to the people actually in possession of the array of 1M processors.

Re:'Human brain' supercomputer with 1M processors switched o... by yellowapple on Monday November 05, 2018 @03:00PM (#18385414)
So I guess by that analogy a neuron is equivalent to a rather slow processor with a 100-kilobit word size?
Re:'Human brain' supercomputer with 1M processors switched o... by Retric on Monday November 05, 2018 @06:29PM (#18386953)
No, Dendrites are far more complex than bits. They have multiple chemical pathways and operate in real time.

A you can think of a single dendrite as ~1,000 bits of information though it's hard to say how much of that information is useful as it's rather complex chemical signaling. Which gets into why opioids get people high for example.

Re:'Human brain' supercomputer with 1M processors switched o... by marmaduke on Monday November 05, 2018 @10:53AM (#18383247)
> Individual neurons run at under 200Hz [1]

maybe but that doesn't account for extensive nonlinear computation happening along dendritic arbors. Think vast decision trees resolved in parallel, per neuron, at 200Hz.

Re:'Human brain' supercomputer with 1M processors switched o... by dkfellows on Monday November 05, 2018 @03:03PM (#18385444)
The processor cores in SpiNNaker run at 200MHz (yes, this is slow!), and can usually issue one instruction per CPU cycle (that's quite nice). However, the trick to getting lots of neurons in is in keeping the number of CPU cycles per synapse event down, since there's a lot more of those than there are neurons.

Yes, bits of the synapse processing code are in assembly coded to waste not one cycle at all. It turns out to be vital to do that in order to keep the efficiency high (and that has many key knock on effects; the synaptic density is a critical parameter for overall model scaling).

In any case, to say that neurons process information at 200Hz is wrong. Or rather it is not even wrong. The individual neurons don't really do very much, but the overall network does a lot and it isn't limited to 200Hz at all. It's just that it handles time in a totally different way to conventional computers...

Re:'Human brain' supercomputer with 1M processors switched o... by amelius on Monday November 05, 2018 @10:54AM (#18383265)
> Individual neurons run at under 200Hz

So anything your brain can think in 1 second needs at most a depth of 200 layers.

Re:'Human brain' supercomputer with 1M processors switched o... by Retric on Monday November 05, 2018 @10:56AM (#18383280)
Each neuron operates on it's own clock cycle which messes with these calculations.
Re:'Human brain' supercomputer with 1M processors switched o... by jakelarkin on Monday November 05, 2018 @12:30PM (#18384119)
anecdotelly every neuron has ~7000 synapses so 200 layers among 7000^200 neurons?

(its probably a meaningless analogy)

Re:'Human brain' supercomputer with 1M processors switched o... by jonplackett on Monday November 05, 2018 @10:50AM (#18383227)
Article says they’re using it to model specific parts of the brain rather than the whole thing for this reason. Also says they plan to add a lot more in future but still only up to mouse-brain territory.
Re:'Human brain' supercomputer with 1M processors switched o... by dkfellows on Tuesday November 06, 2018 @01:40AM (#18388899)
There isn't a plan to do the whole human brain, and doing so would require both at least two further generations of hardware and likely building a new facility for deploying it in. If someone's got a spare billion, and a decade or so to work on it, we could give it a go, but it is a lot to spend for no actual certainty that we'd succeed.

We do plan to simulate the mouse brain, but our interests are more in understanding network-level mechanisms that are difficult to study at the neuron or whole-brain levels. The meso-scale stuff is where understanding is critical and tricky.

Re:'Human brain' supercomputer with 1M processors switched o... by p1esk on Tuesday November 06, 2018 @03:55PM (#18394820)
When you say "simulate the mouse brain", what do you mean exactly? Given as even the c. elegans with its 300 neurons can't be simulated well enough to actually be a living digital organism.