Interesting stuff. To learn that it can take 190 iterations for warm-up to finish may be a revelation to VM developers.

The idea about some runs having slowdowns might not be significant if it's just one run out of 30 that does it though. The result in the last Diagram of TruffleRuby on spectralnorm having 25 slowdowns and 5 no steady-state is interesting.

Full paper at : http://soft-dev.org/pubs/html/barrett_bolz-tereick_killick_m...