Re:Effective Tensorflow
by RBerenguel on Sunday August 13, 2017 @04:48PM
(#15004861)
You can easily differentiate a set of (computer defined) operations formed of composition of standard operations (sums, products, etc), as in, you can define another set of computer operations that is the exact, precise derivative of the first. Wikipedia is a bit dense, but it's explained here: https://en.wikipedia.org/wiki/Automatic_differentiation
"Symbolic operations" is a fancy way of saying you build up the full mathematical equations with operator overloading instead of computing the results at each individual steps. Having the full equations then allows to differentiate with regards to a variable of your choice included in that equation
Something like lazily calculating/evaluating an operation, right?
Re:Effective Tensorflow
by Q6T46nT668w6i3m on Sunday August 13, 2017 @05:44PM
(#15005132)
Yep (from a compilation perspective)
Re:Effective Tensorflow
by RSchaeffer on Sunday August 13, 2017 @04:47PM
(#15004853)
That makes sense. Thank you!
Sorry if this is a stupid question, but can someone explain how symbolic operations allow automatic differentiation or link me to a good explanation?