News for hackers. Stuff that matters.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by amelius on Tuesday March 20, 2018 @03:27PM (#16631738)
Why is computing so specialized towards Deep Learning these days, when it absolutely doesn't need to be? Optimized "kernels" are useful for other kinds of applications as well, such as scientific computing (linear algebra), and image and signal processing.

I can see it coming already: a fast matrix multiplication library, running on a deep learning solution, running on a graphics card. It's kind of ridiculous, isn't it?

Re:NGraph: A New Open Source Compiler for Deep Learning Systems by JacobiX on Tuesday March 20, 2018 @06:16PM (#16633269)
PyTorch for example is often called a deep learning framework. But at its core it is a hardware accelerated linear algebra and tensors library with the support of auto differentiation. So it is well suited for implementing numeric algorithms, classic machine learning algorithms and differentiable programs. DL is really a subset of differentiable programs, but it happens to be a very interesting one.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by krastanov on Tuesday March 20, 2018 @03:39PM (#16631827)
It is already here, actually.

I do a lot of numerics related to simulating quantum computing hardware (which is just linear algebra of fairly large matrices). I have used Theano to write some of the simulations, and there are plenty of projects on github that use TensorFlow as a backend for quantum-mechanical simulations.

Either way, I do not care much whether they call it a "deep learning" framework. It is still directly usable in all other types of linear algebra applications.

Re:NGraph: A New Open Source Compiler for Deep Learning Systems by amelius on Tuesday March 20, 2018 @03:48PM (#16631894)
That's nice, until someone decides to prune certain functionality from future versions of the library because they are not needed for Deep Learning. Or until someone decides: hey, we can replace this floating point computation by a fixed point computation, because it doesn't matter for any kind of Deep Learning anyway.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by claytonjy on Tuesday March 20, 2018 @04:50PM (#16632492)
The maintainers of major DL frameworks like TF and PyTorch intentionally target an ever-wider set of use-cases beyond deep learning, and would not chop out non-DL functionality.

There's many cool non-DL projects using these libraries for fast computation like Pyro (PyTorch) & Greta (TensorFlow), and the community is starting to shift away from DL-specific vocabulary towards terms like "differentiable programming". Deep learning is just one use of this broader paradigm.

Re:NGraph: A New Open Source Compiler for Deep Learning Systems by nl on Tuesday March 20, 2018 @06:06PM (#16633174)
That's really not how it works at all.

Frameworks are layered, and the acceleratored tensor libraries are useful independently of the neural network architectures built on top of them.

It's basically a numpy/scikit like relationship, except both come from the same project.

Re:NGraph: A New Open Source Compiler for Deep Learning Systems by PaulHoule on Tuesday March 20, 2018 @03:48PM (#16631893)
(1) Current Deep Learning tools are still pretty bad; Tensorflow was a huge advance but people hate it.

(2) Differentiable computation has many other applications.

Re:NGraph: A New Open Source Compiler for Deep Learning Systems by dscypher on Tuesday March 20, 2018 @04:29PM (#16632285)
Computations are computations; you certainly don't need to use it for deep learning, but you might want to introduce some new graph-level optimizations if they are appropriate to what you are doing and haven't shown up in deep learning.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by dekhn on Thursday March 22, 2018 @09:44AM (#16648558)
plenty of people are already doing this.

tensorflow can be used to run simulations and other scientific data processing. that's because tensorflow is just a retained computation graph that can be flexibly configured.

we have been doing this since before deep learning was the tech du jour and will be doing it long after.

Re:NGraph: A New Open Source Compiler for Deep Learning Systems by PaulHoule on Tuesday March 20, 2018 @03:47PM (#16631883)
Note no support for ATI gfx cards.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by jennifermyers on Tuesday March 20, 2018 @05:50PM (#16633047)
Not yet, but we would welcome contributions as an open source project!
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by wmf on Tuesday March 20, 2018 @09:06PM (#16634378)
It doesn't even support Intel's own GPUs (although I don't know how useful that would be).
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by jennifermyers on Tuesday March 20, 2018 @09:58PM (#16634672)
Not yet, but our goal is to enable that in the future.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by shmerl on Tuesday March 20, 2018 @05:57PM (#16633107)
CUDA only on the GPU? That doesn't sound good.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by chris_sullivan on Wednesday March 21, 2018 @12:44AM (#16635530)
For now we are targeting CUDA and CUDNN primarily on the GPU backend but we’d love contributions for other GPU transformers! We are highly interested in enabling optimized support for the hardware used in the AI space and are optimistic about support for present and future hardware targets. Please feel free to let us know in our GitHub issues if there is specific GPU or other hardware support you hope to see.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by GregoryPerry on Wednesday March 21, 2018 @08:25AM (#16637416)
Any plans on message passing / clustering with this, so that multiple hardware nodes could be connected to the same computational graph over the network?

Assuming also that this has support for AVX-512 acceleration?

Re:NGraph: A New Open Source Compiler for Deep Learning Systems by wenzhexue on Wednesday March 21, 2018 @11:33AM (#16638938)
We have an allreduce op in nGraph to support data parallel using OpenMPI, and are investigating the best approaches to integrate with frameworks. We also plan to add more collective communication ops to support model parallel in future.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by jbobba on Wednesday March 21, 2018 @12:07PM (#16639382)
Yes, for AVX-512 acceleration.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by auvi on Tuesday March 20, 2018 @03:09PM (#16631590)
I see Baidu's PaddlePaddle in the logos but no mention of it in the article.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by jennifermyers on Tuesday March 20, 2018 @03:24PM (#16631711)
Good catch! The PaddlePaddle logo is faded which means we don't yet have support for it but would love to add it in the near future.
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by kmike84 on Tuesday March 20, 2018 @05:21PM (#16632792)
Interesting, that's good to have more options.

Performance charts in the article are for training of CNNs on CPU. Are there non-educational use cases for that? How does CPU CNN inference speed compare?

Re:NGraph: A New Open Source Compiler for Deep Learning Systems by jbobba on Wednesday March 21, 2018 @12:13PM (#16639463)
We do have to optimize inference code paths for fast training. We are currently adding optimizations that target inference-only use cases (some PRs are already up). Will post data as soon as that is done. Stay tuned!
Re:NGraph: A New Open Source Compiler for Deep Learning Systems by GregoryPerry on Wednesday March 21, 2018 @08:29AM (#16637440)
Also, does this have support for generating monolithic (preferably statically compiled) binaries for the compiled model?