* for just two layers of the visual cortex, V1 and V2 (out of 6 layers). But nevermind for any other brain regions, and never-mind about CNNs applied to speech, robotics, NLP, finance... basically any non-vision domain.
The grandparent post made the point that there could intrinsic characteristics to neural computation shared by natural and artificial networks. There's something that feels right about that, but I'd take it a step further: both natural and artificial networks learn to explain the statistics of the natural world in a compact representation. How many possible equivalently compact representations are there? Wouldn't it seem like a monstrous coincidence if there were multiple representations possible yet both DNNs and the mammalian visual system both decided to represent edges first?
By the way, you should get your anatomy right if you wish to speak so authoritatively: V1 and V2 are not layers of cortex, but rather adjacent cortical subdivisions with cytoarchitecture that correspond to Brodmann areas 17 and 18.
1. https://mitpress.mit.edu/books/visual-cortex-and-deep-networ...
It bears noting that our visual cortex is one of the simpler areas of our brain, considering that equivalent functionality is in all sorts of animals.
It's not a coincidence that DNNs and mammalian visual systems both decide to represent edges first. That's exactly what Yann Lecun was trying to do when he designed convolutional neural nets! You've got the causality mixed up. Yann Lecun explicitly wanted to model the visual system so he came up with a system that would give him the results he wanted (edge detection in the first layer) - which meant linear filters.
I reject the notion that visual cortex is "simple", but I will concede that it is highly conserved across species. This just means that the representations that it uses are effective.
You are no doubt right that Lecun was inspired by the biology of visual cortex (along with theorists before him), but you missed my meaning: can we build a network that doesn't start with edge detectors first that does better? My guess is no.
Spiking neural network models are actually very brain like, but no one really knows how to use them effectively.
I think its also important to realize that we don't have simulate the brain to do what the brain does. If you want to build a flying machine, you could model a bird with flapping wings, but its much easier to just build a fixed wing aircraft. Back propagation may be a similar case. Evolution found a very good way to learn with neurons but it may not be optimal for the things we care about. We may be better off sticking to back propagation because it works so well. Also people are investigating backpropagation alternatives which start to look more and more brain like.
Basically my point is there seems to be intrinsic characteristics of neural computation, which ANNs and real brains both demonstrate.