News for hackers. Stuff that matters.
Re:Lessons of an MIT Education by chrisseaton on Sunday November 05, 2017 @04:19PM (#15631646)
> PLs arguments are very rarely falsifiable

You mean PL design, don't you? Performance work is very empirical. If my new type of inline cache is better then I need to prove that and it's falsifiable (using benchmarks, which I admit aren't ideal).

Re:Lessons of an MIT Education by chrisseaton on Sunday November 05, 2017 @05:11PM (#15631990)
In fact! I can falsify your claim that PL research isn't falsifiable by using some PL research!

http://cis.upenn.edu/~cis501/papers/producing-wrong-data.pdf

> Of the 133 papers published in the surveyed conference pro- ceedings, 88 had at least one section dedicated to experimental methodology and evaluation

Re:Lessons of an MIT Education by fjsolwmv on Sunday November 05, 2017 @08:34PM (#15632944)
That puts it on par with psychology or sociology which has a poor reputation in the falsifiability department
Re:Lessons of an MIT Education by chrisseaton on Monday November 06, 2017 @06:07AM (#15634676)
I think most of the other papers have non-experimental proofs, so it's not that they do nothing rigorous.

And anyway the claim was 'very rarely', when it's actually a majority of cases.

Re:Lessons of an MIT Education by fjsolwmv on Sunday November 05, 2017 @08:36PM (#15632950)
Still, the benchmarks are usually toys and it's pretty easy to find contradictory benchmarking reports. Very few projects do online benchmarking comparisons of different design choices on real workloads