News for hackers. Stuff that matters.
Re:Building a Language and Compiler for Machine Learning by Setepenre on Tuesday December 04, 2018 @07:58PM (#18604910)
No tensorflow does not allow you to do that. Tensorflow differentiate a TF graph. Flux differentiate Julia's IR.

Tensorflow has OP(eration)s that are differentiable that you can compose and that's it. If you want to implement something that is going to be differentiable you need to implement it using Tensorflow OPs or add your own OPs to [tensorflow] with their gradient.

With Flux you can take code written by a random guy on the internet that never thought about using his stuff in ML and Flux will be able to differentiate it anyway.

[1]: https://www.tensorflow.org/guide/extend/op

Re:Building a Language and Compiler for Machine Learning by 0-_-0 on Wednesday December 05, 2018 @04:23AM (#18606805)
Re:Building a Language and Compiler for Machine Learning by FridgeSeal on Wednesday December 05, 2018 @05:28PM (#18613324)
Still a small subset of the language and features

They've also got to manually implement the Python -> autograph translation for a whole variety of language features (so any language features that get added or changed will break autograph until it's updated.

Flux gets this essentially for free, for the entire Julia language, without the need to manually build that language -> tensorflow translation layer. With the added benefit of Julia's non-trivial performance benefits.

Re:Building a Language and Compiler for Machine Learning by byt143 on Wednesday December 05, 2018 @01:24PM (#18610956)
Still a very restricted subset of python, can't autodiff custom types etc