News for hackers. Stuff that matters.
Re:DLVM: A modern compiler framework for neural network DSLs by deepnotderp on Thursday February 22, 2018 @01:29AM (#16435611)
Relying upon a JIT often means the ability to create things which preclude the use of static compilers, which means that accelerated hardware, like ours, cannot be used efficiently.
Re:DLVM: A modern compiler framework for neural network DSLs by yorwba on Thursday February 22, 2018 @03:42AM (#16436169)
The kind of optimizations a static compiler might apply can be done by a JIT as well, with the added benefit of actually knowing what kind of workload is going to run. Most of deep learning is applying comparatively small computation graphs to very large arrays of numbers in parallel, so the overhead of compilation is only a small portion of the overall computation time. A smart JIT that decides on the optimal tiling pattern for the array dimensions observed at runtime and rewrites loops accordingly can easily pay for itself.
Re:DLVM: A modern compiler framework for neural network DSLs by Firadeoclus on Thursday February 22, 2018 @05:46AM (#16436680)
As a counterpoint (and not necessarily the one the GP is referring to), if you were compiling for, say, an FPGA the overhead of compilation would be very significant.
Re:DLVM: A modern compiler framework for neural network DSLs by deepnotderp on Thursday February 22, 2018 @10:15AM (#16438061)
Our processor is analogous to a CGRA, so compilation to it would indeed be hindered by a JIT based compiler.
Re:DLVM: A modern compiler framework for neural network DSLs by gugagore on Thursday February 22, 2018 @11:21AM (#16438662)
That's "course-grained reconfigurable architecture", for anyone else who didn't know.