News for hackers. Stuff that matters.
Re:Neural Networks making a come-back? by larryfreeman on Sunday May 01, 2011 @02:31PM (#2503656)
Are you sure about this? I'm not an expert by any means but when I participated in the Netflix Prize a few years, there seemed to be lots of investigation about different variations of neural networks.

For example, the Restricted Boltzmann Machine (http://en.wikipedia.org/wiki/Boltzmann_machine#Restricted_Bo...), as far as I understand it, seems to be a variation of neural networks.

If you can post a link to an article that covers recent work in the area and explains why they none of them are breakthroughs, I'd love to read it.

Re:Neural Networks making a come-back? by yid on Sunday May 01, 2011 @02:46PM (#2503697)
The backpropagation neural network itself is a variation of many nonlinear, additive statistical models. The field emerged as an independent entity largely because it had "cool" neurological connotations and was largely ignored by statisticians. The Netflix prize was ultimately won using linear algebra with sensible starting values (the KDD paper that describes the winning method is remarkably easy to read).
Re:Neural Networks making a come-back? by dododo on Sunday May 01, 2011 @02:59PM (#2503723)
backpropagation is just the chain rule of differentiation. each layer of an ANN is logistic regression, which statisticians have been and continue to be interested in.

i'm not sure your caricature of the netflix winning solution is correct: i believe it was a blending of around 25 different models (including, i think, the RBM someone pointed about above) each in themselves quite varied from one another. this is typically how these challenges are won.

Re:Neural Networks making a come-back? by yid on Sunday May 01, 2011 @03:19PM (#2503771)
A lot of the top teams had blended submissions, but my characterization was not incorrect: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5197...
Re:Neural Networks making a come-back? by elq on Sunday May 01, 2011 @03:50PM (#2503868)
I work on the cinematch team at netflix... I've reviewed all of the winning code... your characterization is incorrect.

The netflix prize would not have been won when it was without rbm.

Re:Neural Networks making a come-back? by pdhborges on Sunday May 01, 2011 @02:57PM (#2503714)
Is http://www.commendo.at/references/files/kdd08.pdf (this) the paper you are talking about?
Re:Neural Networks making a come-back? by yid on Sunday May 01, 2011 @03:20PM (#2503776)
Nope, it was by Bell and Koren.

This one is related, but not the one I originally mentioned: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5197...

I was at the talk but can't for the life of me remember the title, sorry.

Re:Neural Networks making a come-back? by ignifero on Sunday May 01, 2011 @03:42PM (#2503838)
not an expert either, and indeed, the Hinton papers on RBMs are the last thing i remember reading about. But their invention dates back to the 80s. I 'm just noticing that if you search "neural network" on google scholar for the recent years, you will find many neuroscientific results. Of course i dont have the data to back it up.