Re:Introducing the B3 JIT compiler
by jsnell on Monday February 15, 2016 @05:41PM
(#11106612)
I would say that geometric mean is the usual way of averaging benchmark scores. It has the property that a given relative speedup on a component benchmark always has the same effect on the aggregate score. With an arithmetic mean the component benchmarks with a longer runtime will dominate the aggregate. Normalizing the results before applying the arithmetic mean doesn't really help either -- the first X% improvement to a component benchmark would still be valued more than the second X% speedup.
[ Parent
| on HN ]
There are no comments on this comment yet.