Re:Clojure, Faster
by rcgorton on Friday January 08, 2021 @05:10PM
(#25691180)
I'm concerned about these 'benchmarks'. They are using nanosecond timing intervals. By design, CPU clocks have jitter to resist timing attacks. Secondly, a single clock tick is much more than a nanosecond.
I would feel much more comfortable with performance comparisons (in ANY language) when the duration is on the order of minutes.
[ Parent
| on HN ]
Criterium (the benchmarking library used here) uses multiple runs to obtain tighter bounds on amortized performance, as well as techniques to account for the effects of garbage collection and JIT compilation. See https://github.com/hugoduncan/criterium for a brief overview, as well as links to the pitfalls and statistical techniques involved in JVM benchmarking.