News for hackers. Stuff that matters.
Re:Implementing Neural Turing Machines by albertzeyer on Thursday July 26, 2018 @04:27AM (#17615930)
The result was that constant/zero initialization was the best, which is the most natural choice anyway (for me at least), and definitely also the most simple option. I'm a bit surprised that they emphasise so much on that. Also, not really sure what to learn from this.
Re:Implementing Neural Turing Machines by stochastic_monk on Thursday July 26, 2018 @06:36AM (#17616387)
Does this correspond to an intuition that a tabula rasa may be the best way for a learner to start?