News for hackers. Stuff that matters.
Re:Failures of Deep Learning by curuinor on Friday March 24, 2017 @07:22PM (#13953046)
RNN is natively and obviously dynamical but FFNN can also be seen as transient dynamical system.

Little Ramsey theory ever used in neural network land, but theory of dynamical systems used from quite a long time ago, from Werbos-BPTT which was explicitly envisioned as a dynamical algorithm to the description of the dynamical instability of gradients in RNN.

The statistics of statistical mechanics don't necessarily need to be CLTish sorts of things, you know?

Re:Failures of Deep Learning by bitL on Friday March 24, 2017 @07:30PM (#13953092)
Possibly ;-) I'll study these things in detail soon (hopefully), so far just practical experience with all funny things from DL like self-driving cars, composing music with RNNs etc. but having extensive operations research exp in the past I tend to be careful.