Re:Towards Neural Network-based Reasoning
by nl on Tuesday August 25, 2015 @07:44PM
(#10120188)
It is true that this is an artificial test, but it seems to me that doing well at this is a necessary prerequisite to do well at more complex scenarios.
It's worth noting that these tests were introduced by Jason Weston[1] as "A Set of Prerequisite Toy Tasks"[2]
Also, they didn't report the accuracy on any of the other 18 tasks. That makes me believe that they did pretty badly on those.
Weston's work on Memory Networks has "solved" (or at least shown a good way forward) on 16 of those other tasks. These were the two that were furthest away from being solved (See [2], again). The remaining 2 look like they will fall to Memory Networks with some work.
It's worth noting that these tests were introduced by Jason Weston[1] as "A Set of Prerequisite Toy Tasks"[2]
Also, they didn't report the accuracy on any of the other 18 tasks. That makes me believe that they did pretty badly on those.
Weston's work on Memory Networks has "solved" (or at least shown a good way forward) on 16 of those other tasks. These were the two that were furthest away from being solved (See [2], again). The remaining 2 look like they will fall to Memory Networks with some work.
[1] http://www.thespermwhale.com/jaseweston/
[2] http://arxiv.org/abs/1502.05698