News for hackers. Stuff that matters.
Re:Differentiable Programming Manifesto by kragen on Wednesday November 13, 2019 @11:50AM (#21526197)
The manifesto links one of his papers, "The simple essence", which I've started but haven't finished.
Re:Differentiable Programming Manifesto by seanmcdirmid on Wednesday November 13, 2019 @12:42PM (#21527014)
He has been working on that for a long time. Though much of his earlier work is symbolic differentiation, I’m not very familiar with the more recent AD stuff.
Re:Differentiable Programming Manifesto by thechao on Thursday November 14, 2019 @08:20AM (#21535129)
Let me mostly summarize Conal’s “simple” reverse AD: he drops the tape into the stack. This has two impacts: the stack is “about twice as long”; and, you “may (will?) lose tail recursion”.

It is still a really good paper—and no doubt a lot of the subtlety was list to me.