News for hackers. Stuff that matters.
Re:What’s Next for Artificial Intelligence by jcranmer on Friday August 19, 2016 @04:21PM (#12323180)
Neural networks are based on a very, very outdated (and incorrect) model of how a neuron works, so your question is roughly akin to asking "how many vacuum tubes are in my GPU?"

Mammalian brains are so densely packed that we don't really know what their internal architecture actually looks like--that's why estimates of the number of neurons keeps increasing over time [1]. Most of our models are based on some autopsies, and rely on things like fMRI or electroencephalography (not often you get to spell that word!) to work out which portions of the brain are involved in certain tasks. We have no hope of being able to build a connectivity graph between neurons at our current state of technology.

The short answer is that the cerebral cortex is usually identified as having 6 layers. These can't be correlated with layers in a neural network, however. I do seem to recall a spitball number of 30-ish in relation to the visual cortex, but I've been unable to find any references as to what that number would actually represent, let alone if it's been superseded.

[1] The current estimate is around 100 billion. If you want to know the number involved in, say, the visual cortex, that appears to be on the order of a few billion.

Re:What’s Next for Artificial Intelligence by daveguy on Friday August 19, 2016 @04:48PM (#12323354)
> The short answer is that the cerebral cortex is usually identified as having 6 layers. These can't be correlated with layers in a neural network, however. I do seem to recall a spitball number of 30-ish in relation to the visual cortex, but I've been unable to find any references as to what that number would actually represent, let alone if it's been superseded.

That short answer is very misleading. Those 6 layers are histological layers of density and structure in the cerebral cortex (eg how the cross sections look a little different). You might have many (30+) layers of cells with high interconnectivity in each of those 6 layers. Current estimate is 100 billion for the number of neurons, but the estimate of inter-connectivity is on the order of 100 trillion synapses. The human brain complexity many orders of magnitude higher than anything we have ever "simulated" in silicon.

Re:What’s Next for Artificial Intelligence by Cybiote on Friday August 19, 2016 @06:38PM (#12324026)
It's not misleading because they were careful to point out that these 6 'layers' have nothing in common with how layers are defined in Neural networks. In Neural nets, layers are effectively subgraphs that are bipartite. They can also be computational stages in some networks like convolutional.

The brain's layers are both much more loose in their allowed interconnections but also more modular in their functionality. There are different visual areas (usually 5) at different locations of the neocortex that connect to each other (feedforward and back) in complex ways. As residents of the neocortex, each visual area will thus have 6 layers which are in turn dividable into sublayers (often 1 - 4). These layers are structural but are also partially organizational tools for the scientists.

Re:What’s Next for Artificial Intelligence by ak217 on Friday August 19, 2016 @06:39PM (#12324030)
Thanks, this is good detail. Would you recommend any reading on the up-to-date understanding of brain architecture?
Re:What’s Next for Artificial Intelligence by nononosisisi on Friday August 19, 2016 @06:47PM (#12324068)
Easy, each transistor represents a tube. QED