Re:A Large-Scale Study of Programming Languages and Code Qua...
by s3nnyy on Sunday October 01, 2017 @06:30PM
(#15380241)
That is called p-hacking I guess?
[ Parent
| on HN ]
Re:A Large-Scale Study of Programming Languages and Code Qua...
by carbor1 on Sunday October 01, 2017 @08:28PM
(#15380772)
No, not necessarily. It's standard practice to pick a p-value significance cut-off (0.05), but report the smallest such standard cut-off that any particular value meets. So "p < 0.001" is reported for values that meet that threshold. Anything over the cut-off is just not reported as significant.
Re:A Large-Scale Study of Programming Languages and Code Qua...
by j2kun on Monday October 02, 2017 @01:26AM
(#15381865)
That seems dishonest to me. They're saying that some results are more significant after the fact. Is there any mathematical justification for why this is OK?