News for hackers. Stuff that matters.
Re:Numenta open-sourced their Cortical Learning Algorithm by eli_gottlieb on Friday August 30, 2013 @08:03PM (#6304935)
Ok, so what does this mean to those of us who don't do deep neuroscience-based machine learning that often?

Basically, what problem (problems?) does this algorithm actually solve?

Re:Numenta open-sourced their Cortical Learning Algorithm by rdtsc on Friday August 30, 2013 @10:24PM (#6305448)
That was my main question. How does this compare (either experimentally or theoretically) to already well established approaches.

No references in their paper.

The smells like Wolfram's "New Kind of Science" type work. And they are welcome to prove me wrong, I like AI topics. But it is isolated from other peer work, when AI field is not new. So kind of suspicious.

Re:Numenta open-sourced their Cortical Learning Algorithm by cr4zy on Saturday August 31, 2013 @01:41AM (#6305934)
I've studied Numenta's CLA's, previously HTM's, as well as established ML approaches fairly in-depth over the past couple of years. Hawkins definitely takes a new approach to neural networks and focuses more on modeling the brain's biology rather than building on known artificial neural network concepts. HTM's did incorporate bayesian nets, but have been abandoned, probably with the departure of Dileep George, who now runs http://vicarious.com/.

However, Hawkins work is similar to Deep Neural Nets in that both are unsupervised neural nets (unlike perceptrons and back-prop) and both aim to represent data as sparse representations. Also, here's a similar question I answered on Quora: http://www.quora.com/Machine-Learning/Does-Numenta-build-on-...

In addition, Numenta does use CLA's to solve real problems for customers: https://www.groksolutions.com/solutions.html

Finally, Hawkins' book, On Intelligence, has at least inspired researchers like Stanford's Andrew Ng at a philosophical level which he talks about IIRC in his online ML course. https://class.coursera.org/ml/class

Re:Numenta open-sourced their Cortical Learning Algorithm by p1esk on Saturday August 31, 2013 @02:41PM (#6307665)
Here's an independent review of the older version of the algorithm: http://bias.csr.unibo.it/maltoni/HTM_TR_v1.0.pdf

"Systematic experiments on three line-drawing datasets have been carried out to better understand HTM peculiarities and to extensively compare it against other well-know pattern recognition approaches. Our results prove the effectiveness of the new algorithms introduced and that HTM, even if still in its infancy, compares favorably with other existing technologies."

Re:Numenta open-sourced their Cortical Learning Algorithm by gdahl on Friday August 30, 2013 @10:23PM (#6305441)
Basically none. Numenta has yet to do anything that has impressed any researchers I know. Perhaps someday they will, but I am not counting on it.
Re:Numenta open-sourced their Cortical Learning Algorithm by oxtopus on Friday August 30, 2013 @11:44PM (#6305695)
NuPIC was released as free software, in part, because there has been a strong interest in the academic research community. I encourage you to check out the mailing list (http://lists.numenta.org/mailman/listinfo/nupic_lists.nument...) for some recent examples.
Re:Numenta open-sourced their Cortical Learning Algorithm by gdahl on Saturday August 31, 2013 @12:50AM (#6305822)
Generally, the most relevant academic community would be the NIPS community and I have not noticed any Numenta papers at NIPS, but please point me towards any I have missed if you are aware of any. I expect a lot of people have an opinion along these lines: http://developers.slashdot.org/comments.pl?sid=225476&cid=18... Don't get me wrong, I would love to see numenta produce something of value for the ML community, but it doesn't look good so far.
Re:Numenta open-sourced their Cortical Learning Algorithm by chubot on Saturday August 31, 2013 @01:03AM (#6305845)
Have those researchers released any source code?
Re:Numenta open-sourced their Cortical Learning Algorithm by gdahl on Saturday August 31, 2013 @12:40PM (#6307243)
Yes, plenty. Releasing source code is quite common in the ML community.
Re:Numenta open-sourced their Cortical Learning Algorithm by etrautmann on Saturday August 31, 2013 @01:28AM (#6305911)
I'm a neuroscientist and I'm also not clear on exactly what the anticipated use case for this is. The connection to principles in neuroscience is somewhat loose, it appears to be more grounded in machine learning.