News for hackers. Stuff that matters.
Re:Preliminary test results suggest 21% of NYC residents hav... by ineedasername on Thursday April 23, 2020 @05:02PM (#22961380)
Sure, phone surveys for political purposes (presidential approval ratings etc.) have to deal with that all of the time. There are methods for estimating non-response impact. [0] One method of mitigating it that I've seen it to reach out again to non-responders. You then analyze their results to see how they differ from the baseline responders to estimate the non-responder population. If there's little/no difference, you can be fairly confident the risk of bias is low. It's called non-response follow up, and is a pretty common method.

There's also literature that suggests that you don't discard outlier values in the actual responders as they may help approximate the non-responder population, i.e., the non-outliers represent typical responders while outliers are more likely to represent non-responders [1]

[0]https://www.warc.com/content/paywall/article/jar/research_no...

[1] https://bmcmedresmethodol.biomedcentral.com/articles/10.1186...

Re:Preliminary test results suggest 21% of NYC residents hav... by ineedasername on Thursday April 23, 2020 @10:51PM (#22964160)
Wow, downvoted for providing factual information on how researchers mitigate non-response bias. Didn't think there was anything controversial there. I'm willing to accept the additional downvoted for this comment though.
Re:Preliminary test results suggest 21% of NYC residents hav... by austingulati on Friday April 24, 2020 @12:08PM (#22969574)
Not downvoted by me! Appreciate you sharing this information, it is helping me better understand how researchers mitigate non-response bias. Interesting stuff.