News for hackers. Stuff that matters.
Re:The hippocampus as a 'predictive map' by mh-cx on Tuesday October 03, 2017 @05:34AM (#15391223)
Downvoters please explain what's so stupid about my question.
Re:The hippocampus as a 'predictive map' by _0ffh on Tuesday October 03, 2017 @07:13AM (#15391577)
I didn't downvote, but I have an inkling. I'll share what some of these people may be thinking about your comment. I'll be hyper-critical there because you specifically asked about why someone might have downvoted, so don't take it personally.

"Reading about rewards in AI context makes me wonder, why current AI only focuses on the network topology aspect of natural intelligence."

Well, it doesn't. Not at all. It looks as if you conflate one very specific AI techique (deep neural networks) with all of AI. Because that one technique is currently insanely popular and has been widely mainstream reported and hyped that makes it look as if your education in that field did not go beyond reading a couple of mainstream media articles. Also, there's a whole huge subfield in AI which is actually defined by it's focus on learning from rewards, which you seem not to be aware of.

"What about the neurotransmitters like dopamine or serotonine? Could they (or more specific: their effects) be key to an AI that feels more “natural“?"

Not applicable as written, too broad and unspecific. "Not even wrong." Looks like someone with superficial knowledge is just throwing a few sticks into the blue in the hope that someone might be aroused to a reply which competently tries to make actual sense out of it.

Re:The hippocampus as a 'predictive map' by dwringer on Tuesday October 03, 2017 @09:41AM (#15392310)
If someone only has familiarity with AI from reading passing news stories, it is reasonable to think they would have such a perception of the field. I think your diagnosis of the downvoters might be correct, but "not even wrong" seems a bit extreme. AFAIK somebody out there is probably trying to do a research paper on simulated neurotransmitters as we speak. More interesting would be if anyone had links to existing research in that area. It may not be high-efficiency or high-performance technology, but as a learning tool for exploring theoretical models I think it could be very beneficial.

The topic reminds me of a book I read (and was fascinated by at the time), The Muse in the Machine by David Gelernter. It seems he has moved away from AI research and into political punditry, however, and recently made headlines denying that the moon landing ever happened. Nevertheless, that book contained a lot of exposition around the idea of creating AI with simulated emotion. This is simultaneously in line with the idea of simulating neurotransmitter function, but also has parallels with more general mathematical techniques that are in widespread use. Thus, the book (and perhaps the idea itself) are a bit dated, but I don't think it makes them less relevant.

Re:The hippocampus as a 'predictive map' by _0ffh on Tuesday October 03, 2017 @10:07AM (#15392496)
IIRC there was at least some work done in the 80's and 90's about neural networks where neurons were located in a 2- or 3-D space and could emit "chemicals" that would "diffuse" through the simulated environment and influence neurons' behaviour depending on local concentration. Nothing new here, but maybe the idea is worth another look. Wouldn't be the first time an old idea turns out to be a really good one decades after it's first inception. It might be that the ground is now more fertile for this than three decades ago.

Still, please note that the critiqued comment did not even go as far as to even suggest an idea about the mechanisms involved beyond (implicitly, not even explicitly) "somewhat like in the brain". There's just not enough meat there to even do a proper critique, and on this basis I pulled the "Not even wrong"-card, which is of course at bit harsh, but that was the whole point about trying to put myself into the position of a downvoter.

Re:The hippocampus as a 'predictive map' by derefr on Tuesday October 03, 2017 @04:41PM (#15395992)
Do you know the name of the embedded-in-space work? I'd like to read more about it, but my google-fu isn't turning up anything.
Re:The hippocampus as a 'predictive map' by gnaritas on Tuesday October 03, 2017 @10:54AM (#15392797)
> it is reasonable to think they would have such a perception of the field.

It really isn't; what's reasonable is to always assume whatever you thought of in 10 seconds, has been deeply researched regardless of whether you're aware of it or not. What's reasonable is to assume researchers are vast leagues ahead of whatever shallow thoughts you have on a subject since you "know" you have a shallow understanding. The reasonable person simply asks for links to read deeper about a subject, they don't criticize something they have a shallow understanding of and ask why no one is doing X.

Re:The hippocampus as a 'predictive map' by mh-cx on Tuesday October 03, 2017 @12:14PM (#15393489)
Ok, then please forgive my ignorance. Basically that's what I was asking for (links or sources with deeper informations on the subject).

Of course I made the mistake to use “only“ where it should have been “so much“ or something. Sorry again.

Re:The hippocampus as a 'predictive map' by gnaritas on Tuesday October 03, 2017 @12:54PM (#15393858)
Not criticizing you dude, just commenting on why there may have been down-votes; people don't like it when you imply even unintentionally that researchers are stupid and aren't looking at the right things. I have no expertise in this area so I can't point you at any relevant research, but you can bet if there's something you have a question about, someone out there has a PhD in that topic.
Re:The hippocampus as a 'predictive map' by kortex on Tuesday October 03, 2017 @11:23AM (#15392994)
I suspect it comes across as slightly naive to this audience. The comparison between ANNs/AI and the actual human brain comes up a lot in the general media, and this leads to lots of misconceptions about AI/ANNs/deep learning, and this makes (my opinion) people in both the fields of neuroscience and machine learning a bit salty.

Inescapably, much of the high level ideas in ANN-based machine learning ("connect a bunch of nodes", "integrate and fire", "convolutional neurons/ receptive field") are cribbed directly from neuroscience.

Spiking Neural Networks (see SpiNNaker) and Hierarchical Temporal Memory (see numenta/nupic) aim for more biological plausibility, directly.

*ANNs == artificial neural networks

Re:The hippocampus as a 'predictive map' by pizza on Tuesday October 03, 2017 @06:24AM (#15391379)
I upvoted you, and I'm actually glad you asked the question despite downvotes. I imagine those who did are of the opinion that essentially you're ascribing too much function to the neurotransmitters themselves, as opposed to the contexts in which the presence of the neurotransmitters are used as signals.

Take a look at this brain schematic here [0]. I vehemently disagree with some of the presented-as-fact ideological aspects of the article, but the depiction of neurotransmitters working differently in different brain regions is illustrative.

i.e., a dopamine molecule does not already constitute a meaningful coordinate system -- it doesn't have a meaning in and of itself, such as "the reward molecule", or euphoria/"feel-good"/"addiction trap"/excitement molecule) in the brain. Rather, the dopamine molecule has locally-interpreted semantics.

To make this more concrete with examples of different aspects of dopamine alone:

- "dopamine is known to encode the confidence level of motor predictions" - Scott Alexander, psychiatrist [1]

- saturating the synaptic cleft between neurons with released (or non-recycled) dopamine is a part some euphoric processes (e.g. drugs, orgasm, gambling) in the striatum negra

- 'excess' (not a simple thing to determine for individuals imo) dopamine is related with psychosis (not per se causally), and antipsychotics are often designed to blunt dopamine transmission

However,

- dopamine transmission is also fundamentally necessary for muscle movement, in the motor cortex

- additionally, the conscious sensation of dopamine is highly dependent upon the frequency of dopaminergic neuron spikes

- Parkinson's disease is (iirc, said to be,) the result of the degeneration of motor neurons; shakiness, problems sleeping;

What does that mean for AI? Well, if we want to go beyond network topology, and start to use new varieties of component substrates, the individual types of signals they represent must either a) be fairly meaningless outside of a specific context or b) not be suited for learning from evidence and generalization of data. Check out [2], [3], and [4] for more.

[0] http://www.nationalgeographic.com/magazine/2017/09/the-addic...

[1] http://slatestarcodex.com/2017/09/12/toward-a-predictive-the...

[2] https://www.edge.org/conversation/stephen_wolfram-ai-the-fut... (not that i am a huge fan of wolfram :P)

[3] https://www.edge.org/responses/what-scientific-concept-would..., ctrl-f "biological"

[4] https://en.wikipedia.org/wiki/Multi-state_modeling_of_biomol...

Re:The hippocampus as a 'predictive map' by chiggins on Tuesday October 03, 2017 @11:20AM (#15392971)
Not to derail this further, but your description of Parkinson's disease is incorrect. Dopamine plays a role, but it isn't degeneration motor neurons themselves. There are many effects, but the primary symptoms WRT motor control are caused by death of dopaminergic neurons whose cell bodies reside in the substantia nigra but innervate and regulate firing of corticostriatal pre-motor pathways.

[0] I did my PhD on this

[1] https://en.wikipedia.org/wiki/Parkinson%27s_disease#Pathophy...

[2] https://en.wikipedia.org/wiki/Nigrostriatal_pathway

Re:The hippocampus as a 'predictive map' by pizza on Tuesday October 03, 2017 @02:45PM (#15394915)
TIL, thank you
Re:The hippocampus as a 'predictive map' by andrepd on Tuesday October 03, 2017 @08:06AM (#15391803)
Edit instead of replying to your post.
Re:The hippocampus as a 'predictive map' by mh-cx on Tuesday October 03, 2017 @12:05PM (#15393388)
Couldn't. Maybe not enough karma.
Re:The hippocampus as a 'predictive map' by miguelrochefort on Tuesday October 03, 2017 @08:09AM (#15391822)
People assume you believe your idea is novel when it's not.