Re:Lessons of an MIT Education
by chrisseaton on Sunday November 05, 2017 @05:11PM
(#15631990)
In fact! I can falsify your claim that PL research isn't falsifiable by using some PL research!
http://cis.upenn.edu/~cis501/papers/producing-wrong-data.pdf
> Of the 133 papers published in the surveyed conference pro- ceedings, 88 had at least one section dedicated to experimental methodology and evaluation
That puts it on par with psychology or sociology which has a poor reputation in the falsifiability department
Re:Lessons of an MIT Education
by chrisseaton on Monday November 06, 2017 @06:07AM
(#15634676)
I think most of the other papers have non-experimental proofs, so it's not that they do nothing rigorous.
And anyway the claim was 'very rarely', when it's actually a majority of cases.
Still, the benchmarks are usually toys and it's pretty easy to find contradictory benchmarking reports. Very few projects do online benchmarking comparisons of different design choices on real workloads
You mean PL design, don't you? Performance work is very empirical. If my new type of inline cache is better then I need to prove that and it's falsifiable (using benchmarks, which I admit aren't ideal).