News for hackers. Stuff that matters.
Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @12:02PM (#9625392)
So the OP shouldn't use pop-ups because they'll skew numbers in such a way that he can't tell if pop-ups are effective?
Re:F*** those popups – signing up those who deserve it by mikeash on Friday May 29, 2015 @12:32PM (#9625568)
It's a little more indirect, but yes.

Any time you prompt the user without their asking and they put up nothing of value, the false positive rate will probably be relatively high. If only a small proportion of people sign up, then a small false positive rate (compared to the total number of visitors) can dominate. Thus I don't think the numbers given demonstrate effectiveness, and you shouldn't use something that doesn't demonstrate effectiveness.

I'm a little surprised this opinion has turned out to be so controversial.

Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @12:43PM (#9625651)
If the costs of doing it are close to nothing and there's a pretty reasonable chance it is effective there is no reason not to do it. I also find your analysis less likely than the OP's.
Re:F*** those popups – signing up those who deserve it by mikeash on Friday May 29, 2015 @01:32PM (#9626015)
The cost is in potentially scaring other people away because you annoy them too much. I think the potential there is fairly high.
Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @07:58PM (#9628256)
But there are ways to get a reasonable measure of that, particularly if you at one point did not have them. Yeah, sure, it's probably not good enough to get into a peer reviewed journal, but little of the data you have when running a typical Web site is.