News for hackers. Stuff that matters.
Re:Learning to Execute and Neural Turing Machines by shawntan on Sunday October 26, 2014 @11:42PM (#8513672)
Nitpicking here, but while the authors do use a recurrent neural net (RNN), they do not use it exclusively.

The system consists of a memory element, and a controller element. In their evaluation of the system, they use both a standard feed-forward network, as well as an RNN with long short-term memory (LSTM) units as the controller element. In certain tasks, the feed-forward network works better.

+1 on the deeplearning.net tutorials, and theano. I've learnt a lot from there.

Re:Learning to Execute and Neural Turing Machines by agibsonccc on Tuesday October 28, 2014 @05:34PM (#8523746)
Right. Mainly just low hanging fruit for those who aren't in this stuff day to day.

In a lot of my talks and day to day conversations, I've found people don't know the difference between a feed forward architecture vs, recurrent, vs recursive vs,...you get the point :P