News for hackers. Stuff that matters.
Re:Effective Tensorflow by RSchaeffer on Sunday August 13, 2017 @04:33PM (#15004796)
"The most striking difference between Tensorflow and other numerical computation libraries such as numpy is that operations in Tensorflow are symbolic. This is a powerful concept that allows Tensorflow to do all sort of things (e.g. automatic differentiation)"

Sorry if this is a stupid question, but can someone explain how symbolic operations allow automatic differentiation or link me to a good explanation?

Re:Effective Tensorflow by RBerenguel on Sunday August 13, 2017 @04:48PM (#15004861)
You can easily differentiate a set of (computer defined) operations formed of composition of standard operations (sums, products, etc), as in, you can define another set of computer operations that is the exact, precise derivative of the first. Wikipedia is a bit dense, but it's explained here: https://en.wikipedia.org/wiki/Automatic_differentiation
Re:Effective Tensorflow by make3 on Sunday August 13, 2017 @04:45PM (#15004847)
"Symbolic operations" is a fancy way of saying you build up the full mathematical equations with operator overloading instead of computing the results at each individual steps. Having the full equations then allows to differentiate with regards to a variable of your choice included in that equation
Re:Effective Tensorflow by rockyj on Sunday August 13, 2017 @04:47PM (#15004856)
Something like lazily calculating/evaluating an operation, right?
Re:Effective Tensorflow by Q6T46nT668w6i3m on Sunday August 13, 2017 @05:44PM (#15005132)
Yep (from a compilation perspective)
Re:Effective Tensorflow by RSchaeffer on Sunday August 13, 2017 @04:47PM (#15004853)
That makes sense. Thank you!