Re:Understanding LSTM and its diagrams
by PaulHoule on Wednesday November 15, 2017 @07:02PM
(#15709198)
Usually it requires fewer epochs to train the GRU than the LSTM.
The learning capacity of the LSTM and GRU is proportional to the number of weights, so you need more GRUs to do the job of a given number of LSTMs.
It drives me nuts to see so many tutorials where people do the LSTM because they saw other people do the LSTM when doing the same with the GRU is simpler and better!
Re:Understanding LSTM and its diagrams
by yolorn123 on Wednesday November 15, 2017 @10:36PM
(#15710097)
The reason is there only two gates for Gru, they don't have an internal state as that of LSTM, since having few parameters compared to LSTM it takes less time to train
TL;DR - For most tasks other than Language modeling GRU is better.
The learning capacity of the LSTM and GRU is proportional to the number of weights, so you need more GRUs to do the job of a given number of LSTMs.
It drives me nuts to see so many tutorials where people do the LSTM because they saw other people do the LSTM when doing the same with the GRU is simpler and better!
https://news.ycombinator.com/item?id=12960989
> If a story has had significant attention in the last year or so, we kill reposts as duplicates. If not, a small number of reposts is ok.
https://news.ycombinator.com/newsfaq.html