News for hackers. Stuff that matters.
Re:Automatic Differentiation via Contour Integration by g82918 on Saturday January 18, 2020 @12:10PM (#22085535)
The more relevant link is https://keplerlounge.com/neural-computation/2020/01/16/compl.... Where the author discusses why this repos exists. This isn't a very good way to do AutoDiff and isn't exact(Look at standard reverse mode AutoDiff or Julia or Swift's implementations instead). The point of the repo is that the author believes it is a biologically plausible mechanism for neurons to be trained. Whether it is or isn't is the interesting question.
Re:Automatic Differentiation via Contour Integration by dang on Saturday January 18, 2020 @02:52PM (#22086665)
Ok, we switched to that from https://github.com/AidanRocke/AutoDiff. Thanks!
Re:Automatic Differentiation via Contour Integration by dnautics on Saturday January 18, 2020 @12:41PM (#22085738)
One thing I'm not sure of, is this technique (Monte Carlo forward prop) likely to be more computationally expensive than standard backprop.