Re:Show HN: Boldly go where Gradient Descent has never gone ...
by s_tim on Sunday May 26, 2024 @01:36PM
(#40483912)
How does this compare to Enzyme (https://enzyme.mit.edu/)?
[ Parent
| on HN ]
Re:Show HN: Boldly go where Gradient Descent has never gone ...
by frankling_ on Sunday May 26, 2024 @01:45PM
(#40483986)
Enzyme is traditional, but super duper optimized, autodiff, that is, it returns the partial derivatives for one path taken through the program, ignoring other branches. DiscoGrad captures the effects of alternative branches. What's special about enzyme is that the gradient computations benefit from LLVM's optimization passes and language support.