News for hackers. Stuff that matters.
Re:Brain vs. Deep Learning (2015) by taneq on Tuesday October 03, 2017 @09:36AM (#15392273)
My non-specialist take on it is that, even if what neurons really do is hugely complicated, we should be able to approximate it with something pretty simple and anything sorta close should work. I believe this because real brains are incredibly fault tolerant and can take an absolute beating while still continuing to function 'well enough'.

I'd be willing to bet that once we understand the basic functioning, we'll be able to build a working brain using a few different types of neuron which operate on relatively simple rules-of-thumb, arranged in a few different basic structures which are internally relatively homogeneous.

Re:Brain vs. Deep Learning (2015) by ewjordan on Tuesday October 03, 2017 @04:47PM (#15396037)
I think I tend to agree (and actually, the author does, as well), the interesting question is whether we've been underestimating the number of artificial "neurons" we'll need. If each biological neuron is actually essentially implementing an entire neural net internally, then we might be a lot further from achieving that amount of computation than we expected.

We absolutely need to start doing what you're suggesting, and figuring out how to derive useful basic structures, represent them, and construct networks using those as the building blocks. My prediction is that's where the field will go over the next 5-10 years, a much deeper dive into how to specify connectivity and usefully control it than has been done so far (we're still using fully connected layers, for the most part, which we know is not a scalable approach as we go from thousands to millions of nodes).