News for hackers. Stuff that matters.
Re:Why Do Neural Networks Need an Activation Function? by p1esk on Wednesday July 10, 2019 @12:12AM (#20399087)
I was talking about the property that gradients are linearly proportional to loss value. I don't see whether this property helps or hurts vanishing gradients problem (e.g. if it was not linear, maybe it would be worse).

There are no comments on this comment yet.