Exploring LSTMs

Re:Exploring LSTMs by avaer on Saturday June 10, 2017 @03:38AM (#14526510)

Neural nets that update over time need a way to know what to keep and what to forget from last time. So let's learn what to keep and forget... by using more neural nets.

Disclaimer: I just learned what an LSTM was. But it's a good article.

[ Parent | on HN ]

Re:Exploring LSTMs by backpropaganda on Saturday June 10, 2017 @03:47AM (#14526523)

This is a surprisingly accurate tl;dr for someone who just learnt what LSTMs are.

[ Parent | on HN ]

Re:Exploring LSTMs by dnautics on Saturday June 10, 2017 @04:46AM (#14526644)

One more key point:. Memory is additive, not multiplicative.

[ Parent | on HN ]

Re:Exploring LSTMs by SAI_Peregrinus on Saturday June 10, 2017 @02:44PM (#14528589)

And LSTM stands for Long/Short Term Memory, the definition is only found about a third of the way through the article.

[ Parent | on HN ]

Re:Exploring LSTMs by thrw1001 on Saturday June 17, 2017 @06:25AM (#14575170)

Knowing what the actual units do, I prefer spelling out the acronym as Long Short-Term Memory. They implement short-term memory, like all RNNs do, with a slight improvement to make it long.

[ Parent | on HN ]