Re:New Evidence Shows School Phone Bans Are Gradually Improv...
by oofbey on Tuesday November 17, 2026 @10:17AM
(#50532522)
Sounds like they noticed a few extreme outliers were pulling the difference down and hacked it out. Methodologically that’s really sus to do this after the study is done. But generally I think it’s okay to exclude extreme outliers - we generally assume Gaussian distributions, but the real world happens and messes things up. Having a few kids that are 5 or 6 sigma out pulling your averages - I can believe the rules are different for them. But this should have been decided ahead of time.
[ Parent
| on HN ]
Re:New Evidence Shows School Phone Bans Are Gradually Improv...
by rahimnathwani on Tuesday November 17, 2026 @10:21AM
(#50532588)
Just to be clear, I can't say for sure that the preregistration didn't include the extreme value exclusion. I haven't been able to find a link, but I will email the authors to ask for it.
Re:New Evidence Shows School Phone Bans Are Gradually Improv...
by Balgair on Tuesday November 17, 2026 @11:31AM
(#50533869)
Aside:
Wow! I love this.
I love that you bothered to email them with a thought out question.
I love that they bothered to respond with a thought out answer and they took you quite seriously.
I love that you bothered to tell us about the exchange.
Thank you so much for all of this. This is what we should all strive to do with our time and as a community.
Re:New Evidence Shows School Phone Bans Are Gradually Improv...
by dryanau on Tuesday November 17, 2026 @02:00PM
(#50536447)
Alright mate
Re:New Evidence Shows School Phone Bans Are Gradually Improv...
by buellerbueller on Tuesday November 17, 2026 @02:37PM
(#50536982)
Yeah! Fuck follow-through!
Re:New Evidence Shows School Phone Bans Are Gradually Improv...
by oofbey on Tuesday November 17, 2026 @12:26PM
(#50534897)
Interesting that their take is that the outliers represent measurement errors. Plausible and reasonable. But the fact that it changes the conclusion of the study deserves skepticism.
Re:New Evidence Shows School Phone Bans Are Gradually Improv...
by gamblor956 on Tuesday November 17, 2026 @07:10PM
(#50540124)
The outliers would have made the claimed effect even stronger. They were trying not to overhype their findings.
Re:New Evidence Shows School Phone Bans Are Gradually Improv...
by rahimnathwani on Wednesday November 18, 2026 @12:14AM
(#50542142)
This is incorrect. Please see my earlier comment.