Well, apparently :) They say: We believe that machine learning tools are so important that they deserve a first-class language and a compiler.
However, I'd like to see some numbers on how more efficient it is to build a graph in advance, given that the lion's share of the computations will be in tensor math anyway (which can be heavily optimized, and is independent of the graph).
The problem is that if you build the graph as-you-go, dataflow graph optimizations cannot be done efficiently (some high level optimizations such as data layout optimization, automatic data / model parallelism etc.). Swift can do all these because the compiler can extract the graph out ahead of time.
Re:Keras vs PyTorch
by codetrotter on Thursday June 28, 2018 @07:53AM
(#17416089)
> You just described Swift for TensorFlow
isn't work in progress ?
https://github.com/tensorflow/swift/blob/master/docs/WhySwif...
You just described Swift for TensorFlow.