Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Matrix Calculus for Deep Learning. Parent comment
https://joanbruna.github.io/MathsDL-spring18/
On Tanh and ReLus, the paper on SeLUs is pretty intense.
ReLUs help with vanishing gradients to some degree on a larger degree of loss and activation functions, btw.
edit: On your question about a billion data points and predicting behavior, we are getting there.
http://www.offconvex.org/2017/03/30/GANs2/
There are no comments on this comment yet.
https://joanbruna.github.io/MathsDL-spring18/
On Tanh and ReLus, the paper on SeLUs is pretty intense.
ReLUs help with vanishing gradients to some degree on a larger degree of loss and activation functions, btw.
edit: On your question about a billion data points and predicting behavior, we are getting there.
http://www.offconvex.org/2017/03/30/GANs2/