News for hackers. Stuff that matters.
Re:A TensorFlow implementation of the Differentiable Neural ... by deepnet on Wednesday April 19, 2017 @04:31PM (#14151476)
Neural Turing Machines by Alex Graves, Greg Wayne, Ivo Danihelka

https://arxiv.org/abs/1410.5401

A Neural Turing machine is a type of neural network with addressable memory - it learns rather than being explicity programmed.

The net also learns to boot, i.e. how to read/ write it's own memory from scratch.

Stochastic Gradient Descent learning relies on backpropagation of the error corrections to the individual weights to make a slight improvement - this requires a differentiable neural net.

This version innovates with content addressable memory. The authors demonstrate learning from big data sets and with reinforcement learning, (i.e. trial and error as an embodied agent).

There are no comments on this comment yet.