News for hackers. Stuff that matters.
Re:Towards Neural Network-based Reasoning by fpgaminer on Tuesday August 25, 2015 @12:13PM (#10117475)
If I understand the paper correctly, the architecture is very odd. As far as I can tell, it's equivalent to a deep CNN, with the facts being fed into every couple layers. Why did they break it up into parallel invocations of DNNs, and several layers of DNNs? Very strange.

I imagine a simplified architecture of RNN->Highway CNN->Answerer would achieve better results while being more homogeneous.

Re:Towards Neural Network-based Reasoning by jbaiter on Tuesday August 25, 2015 @01:46PM (#10118274)
Can you explain what you mean with "Highway CNN"? It's the first time I've heard the term and Google doesn't help much either.
Re:Towards Neural Network-based Reasoning by 336f5 on Tuesday August 25, 2015 @01:58PM (#10118365)
http://arxiv.org/abs/1505.00387 Very deep NNs, which try to bypass the training difficulties in propagating error all the way from the bottom to the top by adding some special shortcuts between nodes in distant layers.