News for hackers. Stuff that matters.
Re:Introducing the B3 JIT compiler by panic on Monday February 15, 2016 @04:22PM (#11106103)
Cool stuff! Does anyone know why the geometric mean is used for averaging benchmark scores rather than the usual arithmetic mean?
Re:Introducing the B3 JIT compiler by jsnell on Monday February 15, 2016 @05:41PM (#11106612)
I would say that geometric mean is the usual way of averaging benchmark scores. It has the property that a given relative speedup on a component benchmark always has the same effect on the aggregate score. With an arithmetic mean the component benchmarks with a longer runtime will dominate the aggregate. Normalizing the results before applying the arithmetic mean doesn't really help either -- the first X% improvement to a component benchmark would still be valued more than the second X% speedup.