Re:Why Do Neural Networks Need an Activation Function?
by p1esk on Wednesday July 10, 2019 @12:12AM
(#20399087)
I was talking about the property that gradients are linearly proportional to loss value. I don't see whether this property helps or hurts vanishing gradients problem (e.g. if it was not linear, maybe it would be worse).
[ Parent
| on HN ]
There are no comments on this comment yet.