News for hackers. Stuff that matters.
Re:An Existential Crisis in Neuroscience by dr_dshiv on Saturday January 25, 2020 @11:02AM (#22146798)
What we need is a Newtonian model of the brain. A model that is incomplete and "wrong", but useful and generative. While Newtonian physics may be "wrong", is much easier to learn than quantum physics or relativity, etc.

Neuroscience usually focuses on precision details, but doesn't aim to tell big picture stories. There are a few exceptions, however, like Karl Friston's free energy reduction model.

Re:An Existential Crisis in Neuroscience by SquishyPanda23 on Saturday January 25, 2020 @03:17PM (#22148390)
> What we need is a Newtonian model of the brain.

This seems like an odd take on Newton to me. What made his contributions important is that they were correct up to the precision we could measure for centuries.

We are nowhere near that for a subject like neuroscience.

There have been models adopted by scientests who at the time knew they were wrong and incomplete. For example ancient astronomy or medicine or logic. but their adherents tended to hold back science when new discoveries were made. So they are double edged swords.

Re:An Existential Crisis in Neuroscience by dr_dshiv on Saturday January 25, 2020 @05:11PM (#22148941)
It's a great point. And I agree that precision in stars or mechanics seems much simpler than neuroscience -- but I do actually think that there will be some laws akin to f=ma.

Ok, maybe not quite to that level. But consider this paper, by great neuroscientists and cited over 1000 times, that models brain wave bands as harmonics, with band widths as the golden mean. [1, see figure 4]

My money is on some synthesis of the many theories in oscillatory neurodynamics. Neural resonance, dissonance, harmonics and entrainment... So many of the theories* have borne out empirically, but there has hardly been an attempt at synthesis.

* Theories like "Communication through coherence", "binding by synchrony", "phase amplitude coupling" + "working memory", etc etc etc.

[1] Klimesch, W. (2012). Alpha-band oscillations, attention, and controlled access to stored information. Trends in cognitive sciences, 16(12), 606-617.

Re:An Existential Crisis in Neuroscience by JoeSmithson on Saturday January 25, 2020 @11:42AM (#22147044)
There are several of these (cognitive architectures) e.g. the ACT-R model[0].

[0] https://en.m.wikipedia.org/wiki/ACT-R

Re:An Existential Crisis in Neuroscience by starpilot on Saturday January 25, 2020 @02:58PM (#22148290)
I've noticed a trend of software engineers proposing that other fields create some abstraction that already exists. Last week someone avowed that a citizen regulatory body for aviation be created. Of course, that is the FAA.
Re:An Existential Crisis in Neuroscience by dr_dshiv on Saturday January 25, 2020 @03:17PM (#22148395)
Yes, in "you can't play 20 questions with nature", Alan newell advocated for computational "unified models" of cognition. But they were heavily symbolic. While useful, they don't really make it more understandable. (That's my experience with act-r, anyway! It's useful, but doesn't give big picture synthesis, like a Newtonian model might. It's a lot of little models.)
Re:An Existential Crisis in Neuroscience by asdfgftheaef on Saturday January 25, 2020 @04:27PM (#22148723)
Here's a different perspective:

https://aaai.org/ojs/index.php/aimagazine/article/view/2744

"A Standard Model of the Mind: Toward a Common Computational Framework across Artificial Intelligence, Cognitive Science, Neuroscience, and Robotics"

Re:An Existential Crisis in Neuroscience by The_rationalist on Saturday January 25, 2020 @12:18PM (#22147280)
Which ones aren't BS?
Re:An Existential Crisis in Neuroscience by JoeSmithson on Saturday January 25, 2020 @12:32PM (#22147373)
I'm not an expert at all. I read the book How Can The Human Mind Occur In The Physical Universe? a few years ago and was basically left with the impression that actually cognitive science is way more advanced than I had realised. I was very struck with the amount of definite results and falsifiable experiments (i.e. "actual science"). I think it's one of those things like global poverty where if you are 30 or older, what you learnt at school, and your whole rule of thumb intuition, is totally wrong.

https://www.oxfordscholarship.com/mobile/view/10.1093/acprof...

Re:An Existential Crisis in Neuroscience by abrax3141 on Saturday January 25, 2020 @12:59PM (#22147537)
None of them as BS, or, put more positively, none of these are complete, but each offers different complexly interlocking partial models, at different levels of description. This is how we understand any complex system. Indeed, this is how we understand anything. Indeed, this is what it means to “understand”, that is, to use models to reason about something. Each of these, and all brain and cognitive science, provides different complexly inTeracting models that we use to reason about the system.
Re:An Existential Crisis in Neuroscience by protonfish on Saturday January 25, 2020 @11:32AM (#22146974)
That's a question I asked myself about 10 years ago, so I made one. Is it perfect? Probably not, but I have strived to make it as rational and rigorous as I could. http://behaviorallogic.com/foundations/
Re:An Existential Crisis in Neuroscience by Waterluvian on Saturday January 25, 2020 @11:04AM (#22146808)
Don't we have that in the model that describes what the parts of the brain do?

Proven to be wrong when you watch people with serious brain injuries re learn skills, but shown to have value by how it can predict what tumors or injuries will do to someone's ability.

Re:An Existential Crisis in Neuroscience by conistonwater on Saturday January 25, 2020 @11:32AM (#22146972)
Those models and explanations are not nearly as helpful as one might think. A lot of "neuroscience" explanations of everyday behaviour are mostly nonsense that sounds plausible and appealing (https://www.nature.com/articles/nrn3817, https://www.mitpressjournals.org/doi/abs/10.1162/jocn_a_0075...). In this context plausible doesn't even mean plausible to a neuroscientist, it means more like consistent with the nonsense a layperson has heard before.

What would be really helpful is a model that can add to things we already know. Saying "studying for an exam engages the X part of the brain and uses the Y neurotransmitter" adds literally nothing to your understanding of studying (you can find out much more about studying by talking to people that are good at it and who have done a lot of studying themselves), it's just taking an everyday activity and identifying the small but still vastly complex portion of the brain that is activated more than others. Imagine being told that a particular bug in a 1-billion-lines-of-code codebase is due to some code within a 10-million-lines-of-code portion of it: that's great but how helpful is it really?

Re:An Existential Crisis in Neuroscience by JackFr on Saturday January 25, 2020 @11:42AM (#22147049)
In general I'm very skeptical of much neuroscience. (If an article ever says 'emerging neuroscience shows...' you can be assured what follows is almost certainly BS.) Yet I found the senior researcher in this article quite refreshing about the limitations of their research.
Re:An Existential Crisis in Neuroscience by dr_dshiv on Saturday January 25, 2020 @11:14AM (#22146867)
I would argue not since it doesn't do much for explaining how it works. We know how computers process information. We don't really have a good story for how the brain does it.

We need a story that explains how the brain uses rhythms (oscillations) for computation.

Re:An Existential Crisis in Neuroscience by numpad0 on Saturday January 25, 2020 @11:23AM (#22146916)
We know how to wire FETs, we know this is an i5 and is fast, we also know how to solder thick wires or how to loosen large screws, but no one knows how to build even a Z80 out of some germanium is how neuroscience is understood in my understanding
Re:An Existential Crisis in Neuroscience by jagger27 on Saturday January 25, 2020 @11:09AM (#22146841)
I would equate our current understanding of the brain to the common knowledge that apples fall to the ground from trees; where else would they go? People knew that long before Newton.
Re:An Existential Crisis in Neuroscience by im3w1l on Saturday January 25, 2020 @11:46AM (#22147080)
Almost 2000 years before Newton, Archimedes wrote "Any object, totally or partially immersed in a fluid or liquid, is buoyed up by a force equal to the weight of the fluid displaced by the object."

The ancients knew a fair bit.

Re:An Existential Crisis in Neuroscience by ImaTigger on Saturday January 25, 2020 @02:58PM (#22148288)
What you're looking for is Elman et al's theory in Rethinking Innateness (https://mitpress.mit.edu/books/rethinking-innateness) It's more like Darwin than Newton, and is (to the point of another post off this thread) an early deep-learning-like theory of how the brain (or at least the cortex) becomes organized.
Re:An Existential Crisis in Neuroscience by dr_dshiv on Saturday January 25, 2020 @03:13PM (#22148370)
Have you read smolensky's harmonium paper? It's the first restricted Boltzmann Machine -- and I believe elman and smolensky were colleagues with hinton back at UCSD (with rumelhart and Don Norman, et al).

The approach was focused on presymbolic processing -- and tried to optimize harmony. Harmony was, interestingly, the first mathematical model of the mind (by Pythagoreans/platonists in ancient Greece). It has a lot going for it these days, too, to understand oscillatory coupling in neural circuits. I learned recently that brain waves are harmonics (frequency doublings), which somehow I missed before!

Re:An Existential Crisis in Neuroscience by ImaTigger on Saturday January 25, 2020 @03:21PM (#22148411)
I know about Smolensky's theories (have probably read that paper, but don't remember it exactly; have def. read others by PS); PS and JE are definitely contemporaries, and work/have worked in similar areas. However, these two theories operate at different levels and time scales. The oscillatory coupling theories of PS et al are related to real time computations carried out by neural networks, whereas the trophic wave theories of JE et al. relate to how these networks come to be organized as they are. As per other posts, both are useful, and probably both true to some extent. Neither is directly applicable yet in a way that makes contact with the cognitive level.
Re:An Existential Crisis in Neuroscience by dr_dshiv on Saturday January 25, 2020 @08:20PM (#22149765)
One thing that shocked me was that no one ever tried to connect "cognitive dissonance", one of the most successful social psychology theories of all time, to actual dissonance in neural oscillations.

Consonance results in greater periodicity, meaning that the action potentials are more likely to line up, whereas dissonance has less periodicity, so action potentials don't line up. It feels better (there is pleasure) when the action potentials align because of hebbian reinforcement (synchronous firing). This assumes that reinforcement would be pleasurable, but pleasure is the main reinforcer at a cognitive level.

Re:An Existential Crisis in Neuroscience by mcilai on Saturday January 25, 2020 @12:59PM (#22147533)
Deep learning is as close to being a "newtonian theory" of the brain as it gets -- deep learning abstracts away a lot of the complexity of neural systems (e.g., a simple artificial neuron vs a highly complex biological one) while maintaining a number of essential characteristics: massively parallel computation, error tolerance, graceful degradation, distributed representations, information is stored in slowly-changing synapses, and, most importantly: a simple, local, and powerful biologically-plausible-if-you-squint-hard-enough learning rule.

The important question to ask is: is the deep learning abstraction any good?

There's a very strong case to be made that the answer is yes: deep learning systems can perform many (of course, not all, at least not yet) tasks that involve perception (computer vision/speech recognition), motor control (the recent openai robot), language understanding (machine translation/BERT/GPT), planning (alphago/dota/the deepmind protein folding), and even some symbolic reasoning (the recent work from facebook on symbolic integration https://ai.facebook.com/blog/using-neural-networks-to-solve-...). Some of these tasks are performed at such a high level that they become commercially useful, and in some cases, surpass "human level".

So here we have a "model family" -- deep learning -- with a set of principles so simple that it can be studied with intense mathematical rigor (for example, https://arxiv.org/pdf/1904.11955.pdf or https://papers.nips.cc/paper/9030-which-algorithmic-choices-...), and that produces many of the behaviors we want out of brains (and not just behavioral: see, e.g., https://arxiv.org/abs/1805.10734: " Interestingly, recent work has shown that deep convolutional neural networks (CNNs) trained on large-scale image recognition tasks can serve as strikingly good models for predicting the responses of neurons in visual cortex to visual stimuli, suggesting that analogies between artificial and biological neural networks may be more than superficial." -- this is just one of many papers that show that even under the hood, trained deep learning systems exhibit many properties of biological neural networks).

These reasons strongly suggest (imho) that deep learning is in fact the newtonian theory of neuroscience. More strongly, no other theory comes remotely close in its simplicity and explanatory power.

Re:An Existential Crisis in Neuroscience by friendlybus on Saturday January 25, 2020 @01:14PM (#22147626)
Everybody in the history of humans has said the latest technology is the best model for how a brain works. There used to be a piston model for the brain.

Self driving cars can't leave an enclosed environment and might never do so safely.

Richard Dawkins spoke very highly of the brains ability to do some kind of natural calculus for the sake of tracking a ball in flight, but most animals run on simple tricks and reference points.

Deep learning might be the "good think" for the next ten years, some of us are not going to let go of the transcendent truth that the brain is not defined by what we think it is. I see limited reason to see deep learning as more likely than some emergent behaviour from a vast number of simple rules. Like animals flocking together in a boid sim.

Re:An Existential Crisis in Neuroscience by Strilanc on Saturday January 25, 2020 @03:02PM (#22148319)
> Everybody in the history of humans has said the latest technology is the best model for how a brain works. There used to be a piston model for the brain.

Is this the same mistake as in "The Relativity of Wrong" [1]?

> people have thought they understood the Universe at last, and in every century they were proven to be wrong. It follows that the one thing we can say about out modern "knowledge" is that it is wrong.

> [...]

> My answer to him was, "John, when people thought the Earth was flat, they were wrong. When people thought the Earth was spherical, they were wrong. But if you think that thinking the Earth is spherical is just as wrong as thinking the Earth is flat, then your view is wronger than both of them put together."

Modelling the brain as a bunch of pistons or as a complicated machine or clockwork thing is a lot better than as a magical clay golem or opaque soul. Modelling it as a computer is even better than that. Not a computer in the sense of an x86 desktop exactly, of course, but the concept of computation is clearly fundamental to understanding the system. Similarly, the brain is not ResNet but concepts like backpropagation are probably useful.

So, sure, maybe people have been using the latest fad to explain the brain forever. But that's only bad to the extent that the latest fad is getting further away instead of closer.

1: http://hermiene.net/essays-trans/relativity_of_wrong.html

Re:An Existential Crisis in Neuroscience by friendlybus on Sunday January 26, 2020 @12:16AM (#22150513)
Degrees of wrongness along history would make sense in this discussion if computing were the only path for understanding the brain.

Ancients used to think that thinking happened in the gut and recently the microbiome pathway for describing thought has re-emerged. Both the gut pathway and the computational stream could be wrong.

The outcome of seeing the brain as a computational device will run out of juice like revelation has.

Re:An Existential Crisis in Neuroscience by mcilai on Saturday January 25, 2020 @01:19PM (#22147671)
There's one minor difference between past models of the brain and deep learning: deep learning can actually perform difficult and useful cognitive tasks that cannot be accomplished by any other means.
Re:An Existential Crisis in Neuroscience by friendlybus on Saturday January 25, 2020 @01:30PM (#22147733)
Computers beat chess by grinding out the answers, something previously unattainable for humankind. Computers can beat chess,go and starcraft now with curve fitting ml programs.

The problem is for all this power people still play chess,go and starcraft and we don't know how their brain works.

Re:An Existential Crisis in Neuroscience by __s on Saturday January 25, 2020 @02:02PM (#22147931)
Out of curiosity, do you believe in the concept of a soul?
Re:An Existential Crisis in Neuroscience by ImaTigger on Saturday January 25, 2020 @02:59PM (#22148299)
See my post in another thread re Elman et al. Rethinking Innateness (https://mitpress.mit.edu/books/rethinking-innateness).
Re:An Existential Crisis in Neuroscience by rusk on Saturday January 25, 2020 @11:43AM (#22147057)
You mean like “neuroscience”?
Re:An Existential Crisis in Neuroscience by mcilai on Saturday January 25, 2020 @11:39AM (#22147029)
Deep learning?
Re:An Existential Crisis in Neuroscience by koroe020 on Saturday January 25, 2020 @12:09PM (#22147226)
Translation: your level of familiarity with the material only allows you to “see” it as the separate details.

Daniel Coleman’s “Emotional Intelligence” offers a useful daily model for reasoning around it.

They exist but realize they’re going to “feel” different than physics models. With general physics knowledge one can literally implement tests and build on that independently.

With NS, one can read a model but without imaging machines and chemical testing... shrug... it’s harder to build a muscle memory.

Which neuroscience research argues is super important to connecting details into a composite one can intuit around competently.

Reading AND writing are important to learning English. Same with everything else.

TLDR the practical value of NS is already known: practice learning as we do, don’t be a dick.