News for hackers. Stuff that matters.
Re:Why Does the Neocortex Have Columns? A Theory of Learning... by daveguy on Wednesday October 25, 2017 @02:18PM (#15552642)
I do think his reasoning and focus of what's wrong with ML today is good. Online learning, sequence learning and "motor" feedback are all critical.

Unfortunately he came up with this HTM and appears to be trying to cram all advances into the same framework rather than stepping back and thinking about how those critical features could be implemented differently.

Also as far as I know hebbian learning (like HTM) has achieved ~90% accuracy on MNIST while SOA is above 99% accuracy. So it's not a small gap between HTM and state of the art.

If HTM was near 98% it would be impressive (learning is faster and transfer better). I think alternatives or hybrids are necessary, but he seems stuck on his pet project.

That said, the principles and "what's important for intelligence" I think he is right on target and articulates those aspects well.

There are no comments on this comment yet.