Re:Differentiable Programming Manifesto
by ChrisRackauckas on Sunday November 17, 2019 @09:05PM
(#21561382)
Interesting since the manifesto hasn't mentioned something that's not already completed in Julia. Is their main project or motivation something that is not being shared? I find it quite odd that this manifesto doesn't mention anything that actually requires differentiable programming (old adjoint equations for their applications have existed since the 90's), which makes it a very odd justification for this work.
[ Parent
| on HN ]
Re:Differentiable Programming Manifesto
by taharvey on Friday November 22, 2019 @01:20PM
(#21608310)
I suspect his comments are about the vision for the whole solution and environment, not just auto-diff, which is just a piece.
Auto-diff extends back 40 years. But the relative obscurity of its usage is that it is a "add-on", meta-programming step, or/and a limited sub-set of a language.
The Swift approach of 1st class compiler support is fairly unique. But also supports a future view of computing. If many problems can be solved by differentiable programming, not just the typical but somewhat niche NN/ML problems, then it needs to built into the whole language, not a sub-set.
But more importantly the future requirements, and death of Moore's Law means a fast, deeply statically analyzable language will be required to make the most of a heterogeneous computing environment.