Re:Show HN: Boldly go where Gradient Descent has never gone ...
by big-chungus4 on Monday May 27, 2024 @08:39AM
(#40490206)
In `if i > x`, derivative with respect to x is mathematically 0 at all points. DiscoGrad gives you a useful smooth approximation that is not 0 and lets the function learn those conditional values.
[ Parent
| on HN ]
There are no comments on this comment yet.