Re:The Elements of Differentiable Programming
by naasking on Saturday March 23, 2024 @01:28AM
(#39797705)
Depends what you mean by "additional value". Dual numbers are very simple, and enough for reverse mode AD too though, even via a purely functional implementation:
Provably Correct, Asymptotically Efficient, Higher-Order Reverse-Mode Automatic Differentiation, https://dl.acm.org/doi/pdf/10.1145/3498710