Re:Compiler Auto-Vectorization with Imitation Learning [pdf]
by gok on Tuesday January 07, 2020 @10:52AM
(#21981089)
ML seems like a great approach for compiler optimizations, as hand-written heuristics have become almost unmaintainably complex. As the paper mentions, reinforcement learning could be even more powerful.
The biggest barrier to deploying this kind of thing is probably ML skepticism in the compiler world.
Re:Compiler Auto-Vectorization with Imitation Learning [pdf]
by candiodari on Wednesday January 08, 2020 @06:36AM
(#21990493)
One hope that this might be able to improve a bit on the traditional problem you experience with optimizers: "will it still optimize if I move this calculation 1 line down?".
I find the big problem with optimizers these days is not performance anymore. I'd just so gladly trade even 2-3% performance for assurance that it's going to actually work, even if I move bits of code around a little bit. That it won't slow down by a factor 2-3x.
Re:Compiler Auto-Vectorization with Imitation Learning [pdf]
by thsealienbstrds on Tuesday January 07, 2020 @05:27AM
(#21978669)
So, the advantage of this method is that it is practical and the closest one to a method that produces the optimal solution. Where the latter method is at risk of crazy compile times because it relies on solving a problem that is NP-hard?
Re:Compiler Auto-Vectorization with Imitation Learning [pdf]
by ekelsen on Tuesday January 07, 2020 @10:33AM
(#21980864)
I'm generally unclear about the utility here - goSLP which generates the training data seems to be significantly better at ~1.04. Is it because the NN might be faster?
It would be illuminating to see approximate compile times. The 1.015 number comes from 10 rollouts. Speedups are < 1 for 1 rollout. How long does goSLP take vs. LLVM?
Re:Compiler Auto-Vectorization with Imitation Learning [pdf]
by throwlaplace on Tuesday January 07, 2020 @03:24PM
(#21984397)
does anyone know other areas of research at the intersection of ML and compilers/languages? obviously i'm aware of building in auto-diff (S4TF) and things like that but i mean outside of that and more things like this - where you use both ML and PL/compiler theory.
Re:Compiler Auto-Vectorization with Imitation Learning [pdf]
by _Microft on Tuesday January 07, 2020 @04:07AM
(#21978280)
The title was unnecessarily editorialized?
The actual title is "Compiler Auto-Vectorization with Imitation Learning". It is currently titled "MIT researchers develop new technique to generate compiler optimizations [pdf]". Please don't do this.
Re:Compiler Auto-Vectorization with Imitation Learning [pdf]
by charmen on Tuesday January 07, 2020 @11:55AM
(#21981765)
The MIT news article is about the original performance prediction work, which is an important piece for future reinforcement learning-based approaches. (https://github.com/ithemal/Ithemalhttp://proceedings.mlr.press/v97/mendis19a.html). The imitation learning approach is a step towards how to automate the development of compiler algorithms. Note that we are not merely tuning heuristics, we learn the entire optimization algorithm.
The biggest barrier to deploying this kind of thing is probably ML skepticism in the compiler world.
* has a 22.6% higher average reduction in cost compared to LLVM compiler (as measured with its own cost model); and
* achieves a geometric mean runtime speedup of 1.015× on the NAS benchmark suite when compared to LLVM’s SLP vectorizer.
In short, the DNN achieves better performance in an NP-Hard problem than human-tuned heuristics and human-designed algorithms.
I find the big problem with optimizers these days is not performance anymore. I'd just so gladly trade even 2-3% performance for assurance that it's going to actually work, even if I move bits of code around a little bit. That it won't slow down by a factor 2-3x.
It would be illuminating to see approximate compile times. The 1.015 number comes from 10 rollouts. Speedups are < 1 for 1 rollout. How long does goSLP take vs. LLVM?
The actual title is "Compiler Auto-Vectorization with Imitation Learning". It is currently titled "MIT researchers develop new technique to generate compiler optimizations [pdf]". Please don't do this.