Re:Towards Neural Network-based Reasoning
by jbaiter on Tuesday August 25, 2015 @01:46PM
(#10118274)
Can you explain what you mean with "Highway CNN"? It's the first time I've heard the term and Google doesn't help much either.
http://arxiv.org/abs/1505.00387 Very deep NNs, which try to bypass the training difficulties in propagating error all the way from the bottom to the top by adding some special shortcuts between nodes in distant layers.
I imagine a simplified architecture of RNN->Highway CNN->Answerer would achieve better results while being more homogeneous.