Re:It’s not just p=0.048 vs. p=0.052
by UncleMeat on Wednesday September 11, 2019 @11:54AM
(#20941512)
This is true in more than just psych. A strategy for systems papers is to select the system that is second on the graphs. The author's results are not trustworthy, but the second place system was usable and ran reasonably well in the hands of somebody other than the original author.
For ML practitioners out there, this is a great method for a field also in a replication crisis.
More importantly, p=0.06 means that the researchers are honest. They could have easily p-hacked the results below 0.05 but chose not to. The opposite is true when p=0.049.
https://putanumonit.com/2018/09/07/the-scent-of-bad-psycholo...