News for hackers. Stuff that matters.
Re:Show HN: Boldly go where Gradient Descent has never gone ... by big-chungus4 on Monday May 27, 2024 @08:39AM (#40490206)
In `if i > x`, derivative with respect to x is mathematically 0 at all points. DiscoGrad gives you a useful smooth approximation that is not 0 and lets the function learn those conditional values.

There are no comments on this comment yet.