News for hackers. Stuff that matters.
Re:New Evidence Shows School Phone Bans Are Gradually Improv... by tfirst on Tuesday November 17, 2026 @09:31AM (#50531895)
The identification in this study is a sketchy, and a similar study in the exact same setting ((https://tom-dee.github.io/files/w35132.pdf) doesn't find a significant effect.

1. they see diverging pre-trends, which immediately suggests a problem in the diff-in-diff 2. they're doing some kind of propensity score matching to build a comparison set, and it looks like they're matching across state lines, which is going to expose them to all sorts of weird state-level shocks 3. while the previous study just looked at the impacts on grades, they've built a value-added model and they're estimating their effects through that. That just adds another place where they can get the model wrong and end up with bad estimates.

They also point out that the schools that bought these pouches had more ESSER money, which they could have spent on tutoring.

Re:New Evidence Shows School Phone Bans Are Gradually Improv... by rahimnathwani on Tuesday November 17, 2026 @03:35PM (#50537800)
I wish I could upvote this comment more than once.

Many reactions in this thread seem to be based on people's pre-existing beliefs, rather than the strength of evidence in the paper itself, which I think is weaker than the article suggests:

https://news.ycombinator.com/item?id=50531865

Re:New Evidence Shows School Phone Bans Are Gradually Improv... by tfirst on Tuesday November 17, 2026 @06:28PM (#50539700)
I missed your point about the winsorization, and there are many more decisions in the study that could completely change the estimates. This paper is like a case study in the garden of forking paths in research.