News for hackers. Stuff that matters.
Re:Nilang.jl – A Reversible Julia DSL by ssivark on Sunday October 11, 2020 @11:33AM (#24746459)
Is this in essence the same as the relation between a differential equation and it’s adjoint equation, and how one could use the asking method to perform back propagation? (Eg: ref. Neural ODEs)
Re:Nilang.jl – A Reversible Julia DSL by GiggleLiu on Sunday October 11, 2020 @03:06PM (#24748196)
NiLang requires every instruction being reversible, e.g. `SWAP` and `y += f(args...)`. The back-propagation is implemented on a limited instruction set. It is different with Neural ODE because neural ODE does not back propagate the program step by step. Some time reversible integrator can utilize the reversibility (with NiLang) to save memory. e.g. the leap frog integrator for symplectic systems.