Re:Measure code execution time accurately in Python
by gdxhyrd on Saturday January 18, 2020 @02:06PM
(#22086338)
You are speaking as a stats person. :)
While there are dozens of things that can go south in benchmarking, how to solve them is not about applying advanced stats, but about understanding and eliminating the sources of noise.
Most benchmarks in CS can be done quite easily as long as one understands all the technology stack.
Re:Measure code execution time accurately in Python
by cscheid on Saturday January 18, 2020 @02:50PM
(#22086652)
I'm not a stats person! But I have been burned in real projects by doing the wrong thing. I just have learned --- the hard way --- to honestly appreciate it.
While there are dozens of things that can go south in benchmarking, how to solve them is not about applying advanced stats, but about understanding and eliminating the sources of noise.
Most benchmarks in CS can be done quite easily as long as one understands all the technology stack.