News for hackers. Stuff that matters.

A comment on Why Neurons Have Thousands of Synapses: a Theory of Sequence Memory in Neocortex. Parent comment

Re:Why Neurons Have Thousands of Synapses: a Theory of Seque... by p1esk on Thursday November 05, 2015 @05:19PM (#10516533)
H in HTM stands for "Hierarchical". This means, that it can, in principle, construct more general, more abstract SDRs (patterns) based on many low level SDRs it sees. Thus it's plausible to see forming of ideas out of sentences, or something similar. This is how it can build a world model, and then run your input through multiple levels of abstraction, as many as needed to give a high confidence answer.
[ Parent | on HN ]
Re:Why Neurons Have Thousands of Synapses: a Theory of Seque... by mjpuser on Friday November 06, 2015 @01:59PM (#10521249)
My example was also spoon feeding questions and answers to the HTM. If you were to just give it a corpus of text, and then ask it a question about that text, it would not be able to formulate an answer that has any meaning, and follow proper English grammar. If you disagree, you can respond with a working example.
[ Parent | on HN ]
Re:Why Neurons Have Thousands of Synapses: a Theory of Seque... by p1esk on Friday November 06, 2015 @11:16PM (#10523684)
If you disagree, you can respond with a working example.

I am the working example. I can read texts and answer questions. HTM is an attempt to explain how I do that. Obviously, it's an incomplete theory, but its main ideas make sense to me. You got a better theory?

[ Parent | on HN ]
Re:Why Neurons Have Thousands of Synapses: a Theory of Seque... by mjpuser on Monday November 09, 2015 @12:58PM (#10534572)
I don't have a better theory, but that wasn't my point. It may be that there is a setup to read and understand language, but there has never been code presented based on this technology that does it. This is why I'm interested to see how you could set it up to make it work. If you could prove me wrong, then great! I'd love to see it.
[ Parent | on HN ]
Re:Why Neurons Have Thousands of Synapses: a Theory of Seque... by p1esk on Monday November 09, 2015 @10:20PM (#10537421)
HTM is a theory. It's very incomplete at this point, because our understanding of the brain is very incomplete. Numenta published their code as they discover more and more about the brain. Once the system is complete enough to process language, the code will be able to process language.
[ Parent | on HN ]