News for hackers. Stuff that matters.
Re:F*** those popups – signing up those who deserve it by gk1 on Friday May 29, 2015 @11:14AM (#9625039)
In case you're wondering why anyone would use these _obviously_ annoying popups, here's why: If done right, they actually work.

Here's a real example:

In March I added a delayed popup to my blog to invite people to subscribe for future updates about user acquisition. It was on a delayed timer so that the reader has a chance to at least get part-way through the post. Also, if you closed it out once then you wouldn't see it again for something like 30 days.

Since then, it's been seen by 11,848 people, of whom 232 (1.96%) signed up.

Most blog readers come for the article, not for the blog or the company. They read the article then carry on with their lives, even if the article was very helpful or interesting to them.

Here's how I see it: I now have 232 people who are actually interested in learning about user acquisition, and gave me permission to send them more helpful posts. I wouldn't have this if I never asked them to enter their email. I realize the price to pay for this is mildly annoying the other 98%.

With that said, I'm trying to minimize that annoyance. I'm now experimenting with a less invasive prompt; a thin bar at the top of the screen, that also hides when you're scrolling down (presumably reading). If it still gets subscribers _and_ is less annoying to the others, then I'll keep it.

tl;dr - Companies know and don't care that popups are annoying, because they're effective. Some companies care a little and try to make the popups less annoying to those who wouldn't have signed up anyway.

Re:F*** those popups – signing up those who deserve it by alyx on Friday May 29, 2015 @11:27AM (#9625144)
"I realize the price to pay for this is mildly annoying the other 98%."

To me this does not make sense, and is exactly the reason I avoid annoying users in my applications (advertising or otherwise). Because you definitely have numbers to back up the effectiveness of the popup (although I would argue it is not effective). What you don't have is of the 98% you annoyed, how many will not return because of the annoyance (by choice anyway).

Or to put in another way,

Would you implement a feature in your software that only benefitted 2% and annoyed the 98%?

Seems like this kind of approach hints at a deeper issue here and that's effective targeting.

Re:F*** those popups – signing up those who deserve it by notdanariely on Friday May 29, 2015 @11:31AM (#9625178)
My other comment in this thread addressed this, but basically, I think it's a filter for removing those site visitors unlikely to become customers, allowing a company to focus on people who are receptive to the medium (popup) as well as the message. These people are going to be easier to advertise to, because they don't get pissed off when you put an ad in front of them.

The software analogy is invalid, because those people are already your users or customers. In the case of reading the article, think of a popup as a criterion filter in much the same way as 419 scammers use poor english.

Re:F*** those popups – signing up those who deserve it by wernercd on Friday May 29, 2015 @11:32AM (#9625186)
People have been mildy annoyed by adverts for decades: TV Commercials.

Just because it's mildly annoying, doesn't make them any less effective either. There wouldn't be millions spent on Super Bowl slots if they weren't effective (although the SB is an outlier with regards to adverts).

Except for really bad popups, I can find an x, click it and move on - or ever so occasionally actually sign up for something...

It hasn't been until recently that you could timeshift or torrent TV shows consistently to not see the commercials. They do show that mildly annoying can still be effective and profitable.

Re:F*** those popups – signing up those who deserve it by gk1 on Friday May 29, 2015 @11:36AM (#9625212)
Your software and your blog have _very_ different audiences. I wouldn't risk annoying 98% of paying customers. People who randomly stumbled onto my blog from some Tweet, are not likely to be prospective customers, and are not likely to ever return again? Yeah, I'll take that chance.
Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @11:36AM (#9625215)
If people don't want to see any solicitations at all then I guess they ought to pay for Web content, which they have pretty consistently proven unwilling to do.
Re:F*** those popups – signing up those who deserve it by mikeash on Friday May 29, 2015 @11:26AM (#9625133)
How many of those 232 signed up because they want to receive e-mails from you, and how many signed up because they thought they had to in order to proceed?

If you put up a prompt saying "enter your e-mail address" then a lot of people will obey regardless of your reason for prompting. Most computer users don't really understand computers and have no idea when a site would legitimately require an e-mail address and when a site just wants it so they can send you spam. This is especially true when you use a popup that blocks access to the page. It would be easy to assume that signing up is required in order to continue reading the page.

Re:F*** those popups – signing up those who deserve it by gk1 on Friday May 29, 2015 @11:31AM (#9625172)
For my case, I should clarify that I also have double opt-in enabled for my email list, which means someone doesn't _really_ get added to the list until they click a verification link in their email.

So if anyone did enter their email just to continue, they're not counted in that 232. I don't think that's likely, though, since the message was clear about what it is:

> Want more users?

> OK, that was a cheap trick. Of course you do.

> The real question is... Do you want to learn the hard way, or would you rather get battle-tested lessons and case studies about user acquisition sent to you about once monthly?

> [Yes, keep me updated](button)

I agree, though, that many companies are doing this absolutely wrong, and one of the ways to get it wrong is not being clear about the value of entering your email.

Re:F*** those popups – signing up those who deserve it by mikeash on Friday May 29, 2015 @11:39AM (#9625236)
People willingly enter their credentials after clicking on links in obvious phishing e-mails that they have no idea why they received. Do you really think it's unlikely that people clicked your verification link without intending to sign up for additional e-mails from you?

It looks to me like you're suffering from the base rate fallacy. You're basically saying, it's unlikely to sign up by accident, therefore most of my signups are intentional. But because the number of people who signed up is very small compared to the number of people who visited, that's not how it works.

Let's say that people sign up by accident with a probability of 1%. (We might break that down by saying that, for example, 10% of people who visit think that entering their e-mail address is mandatory, and 10% of people who receive the verification e-mail click the link either by accident or because they think they have to somehow.) That might seem like a nice low rate and thus almost all of your 232 signed up intentionally. Not so! If 0.2% of people sign up by accident then that means that 118 people signed up by accident, giving you about 50% of your people who signed up doing so by accident. If the accidental signup rate is 2% then that means there are no legitimate signups at all in that 232. I have no real idea what the true rate would be, but 1-2% is plausible to me, and so I don't think you can conclude anything about how well this stuff works from this information.

Re:F*** those popups – signing up those who deserve it by gk1 on Friday May 29, 2015 @11:52AM (#9625326)
If a person unknowingly does all this: Open blog about user acquisition --> Confuses message about "email updates" to mean they must enter their email --> Opens and clicks verification email clearly stating it's to receive updates --> Proceeds to open future emails about user acquisition and does not unsubscribe... Well, good thing for them that I'm not an African prince.
Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @11:49AM (#9625298)
> People willingly enter their credentials after clicking on links in obvious phishing e-mails that they have no idea why they received. Do you really think it's unlikely that people clicked your verification link without intending to sign up for additional e-mails from you?

If people are entering their e-mails and clicking a verification link without wanting to receive e-mails it's absolutely their own damn fault and I don't care.

Re:F*** those popups – signing up those who deserve it by mikeash on Friday May 29, 2015 @11:52AM (#9625317)
You may not care about spamming them afterwards (and I sympathize with that view... there's only so much you can do) but if it skews your numbers to the point where you can't determine whether your popups are actually effective, surely you care about that?
Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @12:02PM (#9625392)
So the OP shouldn't use pop-ups because they'll skew numbers in such a way that he can't tell if pop-ups are effective?
Re:F*** those popups – signing up those who deserve it by mikeash on Friday May 29, 2015 @12:32PM (#9625568)
It's a little more indirect, but yes.

Any time you prompt the user without their asking and they put up nothing of value, the false positive rate will probably be relatively high. If only a small proportion of people sign up, then a small false positive rate (compared to the total number of visitors) can dominate. Thus I don't think the numbers given demonstrate effectiveness, and you shouldn't use something that doesn't demonstrate effectiveness.

I'm a little surprised this opinion has turned out to be so controversial.

Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @12:43PM (#9625651)
If the costs of doing it are close to nothing and there's a pretty reasonable chance it is effective there is no reason not to do it. I also find your analysis less likely than the OP's.
Re:F*** those popups – signing up those who deserve it by mikeash on Friday May 29, 2015 @01:32PM (#9626015)
The cost is in potentially scaring other people away because you annoy them too much. I think the potential there is fairly high.
Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @07:58PM (#9628256)
But there are ways to get a reasonable measure of that, particularly if you at one point did not have them. Yeah, sure, it's probably not good enough to get into a peer reviewed journal, but little of the data you have when running a typical Web site is.
Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @11:35AM (#9625205)
I've seen these be used effectively to solicit nonprofit donations, and no one is going to just start sharing their credit details and donation amount without some understanding of what they are doing.
Re:F*** those popups – signing up those who deserve it by mikeash on Friday May 29, 2015 @11:41AM (#9625248)
I would dispute that (see 419 scams for example) but it ultimately doesn't matter, when measuring effectiveness of a donation, whether understanding took place. The real question there would then be whether the popups generated more donations than they scared away, which is tough to measure.
Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @11:45AM (#9625270)
Actually it's very easy to measure and the answer is "yes."
Re:F*** those popups – signing up those who deserve it by remarkEon on Friday May 29, 2015 @11:24AM (#9625119)
Honestly, most of the time when I'm reading something and I get a half-way popup like that, or a popup after I click the 2nd page of a multi-page article, I just leave. I find it almost disrespectful to the user.
Re:F*** those popups – signing up those who deserve it by notdanariely on Friday May 29, 2015 @11:29AM (#9625151)
I don't say this to criticize anything you said, but to offer the perspective of a company.

If they produce content for the sake of conversions, does it really matter to them if you hit back as soon as you see the popup? You've self-selected to indicate you aren't interested in doing business with them based on their popup practices.

From their perspective, this could be a bonus. Not that server resources are that scarce, but sales resources can be. Now they don't have to have someone call you, don't have you in their denominator lowering their conversion-to-sales rate, etc.

Perhaps it's just a way for both reader and publisher to see if they're a match.

Re:F*** those popups – signing up those who deserve it by cgarvey on Friday May 29, 2015 @11:57AM (#9625357)
I think one failure point of this thought process is that popup practices don't relate to the content or why the User clicked on the article to begin with. Popups that cover/interrupt the content aren't necessary and shouldn't be a "match" indicator for your company. Unless you're in the business of selling "annoying" products and you need people who are tolerant of that or enjoy being annoyed.
Re:F*** those popups – signing up those who deserve it by notdanariely on Friday May 29, 2015 @06:16PM (#9627827)
An interesting addition, thank you!

After considering your comment, I still think my original point stands. Instead of thinking about the product being sold, think of it like qualifying a lead based on their receptiveness to your advertising.

It would need to be tested whether that would be more highly correlated with conversions / profits, but I'd probably consider someone who is receptive to my advertising as a higher priority lead than someone who is interested primarily in my content.

Re:F*** those popups – signing up those who deserve it by JoeAltmaier on Friday May 29, 2015 @11:26AM (#9625135)
There's no way I finish reading anything that pops up halfway through. That's just more callous manipulation of my browser. I leave instantly. If the back button doesn't work, I kill it.

How many of those 11,848 people didn't finish your article? Do you care?

Re:F*** those popups – signing up those who deserve it by gk1 on Friday May 29, 2015 @11:38AM (#9625228)
That's a good question, and I do care. And because I know the HN crowd is less tolerable of these things, I actually had a filter to NOT show it to visitors referred by HN.

And now, as I mentioned, I'm experimenting with a different type of prompt that I hope will lower that risk.

Re:F*** those popups – signing up those who deserve it by JoeAltmaier on Friday May 29, 2015 @11:57AM (#9625359)
Wow, that's cynical. You want HNers to spread the word, so they get a sanitized version? That's borderline creepy. Now I recommend a site, and the people I recommend to are thinking I'm an idiot for recommending an ad-riddled site.
Re:F*** those popups – signing up those who deserve it by gk1 on Friday May 29, 2015 @04:21PM (#9627043)
No. I'm slightly customizing the experience for a certain group of visitors.

Do you find web analytics creepy? Or A/B tests? Or cookies? If you think your browsing behavior isn't affecting what you're served on a site, then you're in for a surprise...

Re:F*** those popups – signing up those who deserve it by JoeAltmaier on Saturday May 30, 2015 @09:41AM (#9630140)
You can pretend its not a cynical attempt to mislead a critical segment into recommending your site, though they wouldn't if they knew what it was really like. I'm an HNer. This is personal, so its creepy.
Re:F*** those popups – signing up those who deserve it by wernercd on Friday May 29, 2015 @11:41AM (#9625246)
How many people stop watching Friends or The Walking Dead because of a commercial? How many sales are made because of the commercials?

I'm all for adblockers... but to say that ads can't be unobtrusive and effective is ignoring the fact that they are obviously worth the effort.

Re:F*** those popups – signing up those who deserve it by JoeAltmaier on Friday May 29, 2015 @11:55AM (#9625345)
Those shows are carefully crafted experiences, with breaks written into the action. The internet experience is nothing like that.
Re:F*** those popups – signing up those who deserve it by TheLoneWolfling on Friday May 29, 2015 @04:09PM (#9626969)
I did.

I pretty much gave up on TV because of the commercials.

Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @11:37AM (#9625220)
Oh no you have to press the escape button once. I wouldn't care, personally.
Re:F*** those popups – signing up those who deserve it by JoeAltmaier on Friday May 29, 2015 @12:05PM (#9625408)
Don't be silly. They get more convoluted every day. Hidden close buttons, countdowns, close buttons in the wrong corner of the box, overlays that you can't dismiss without entering data. Every disruptive thing gets done, all with the rationalization that the customer really wants your product and you're doing them a favor.
Re:F*** those popups – signing up those who deserve it by emodendroket on Friday May 29, 2015 @12:22PM (#9625517)
You're conflating different issues.
Re:F*** those popups – signing up those who deserve it by mplscoder on Friday May 29, 2015 @04:03PM (#9626925)
How many people left the page before bothering to close the popup? That's the metric I care about (and usually my behavior)
Re:F*** those popups – signing up those who deserve it by jgaxn on Friday May 29, 2015 @05:14PM (#9627498)
We ran a test of info-gathering popups on one of my sites a little while back. We split tested using various triggers.

popup after 5 seconds:

- 73.5% left the page without closing the popup.

popup after 10 seconds:

- 75.8% left the page without closing the popup.

popup triggered when the user scrolled near the bottom of the page:

- 21.5% left the page without closing the popup.

The scroll trigger was pretty useless though because only 2.6% of users scrolled low enough to trigger it.

Re:F*** those popups – signing up those who deserve it by true_religion on Friday May 29, 2015 @05:59PM (#9627751)
I'm curious... is that 75.8% a bounce rate from the entire site, or just navigating away from the page?
Re:F*** those popups – signing up those who deserve it by jgaxn on Friday May 29, 2015 @06:55PM (#9628015)
Navigating away from the page, although there was no interaction on the popup that would have kept them on the site so they left entirely.

It should be noted that the traffic to that site at that point was nearly 100% search traffic looking for a specific data point and the content on the page was tables of data, not an article. I would assume that a site with an engaging article would have a much smaller bounce rate.

Re:F*** those popups – signing up those who deserve it by userbinator on Friday May 29, 2015 @11:31AM (#9625175)
subscribe for future updates about user acquisition

There is something about doing user acquisition on a blog about user acquisition that I find strangely amusing... and perhaps your visitors have already become desensitised to it, as this is what they're looking for.

Re:F*** those popups – signing up those who deserve it by gdilla on Friday May 29, 2015 @11:55AM (#9625344)
if a few (2%) slip through, it's better than 0 I guess. But why do they have to be in your face? Can't they just slide up on the bottom of the page and stay down there so you can at least finish the sentence you're reading? I'm asking this as a general question.
Re:F*** those popups – signing up those who deserve it by gk1 on Friday May 29, 2015 @11:58AM (#9625371)
I was wondering the same thing so that's why I'm trying out a different version now.
Re:F*** those popups – signing up those who deserve it by sukilot on Friday May 29, 2015 @11:27AM (#9625140)
How many of those 232 have generated revenue?
Re:F*** those popups – signing up those who deserve it by untog on Friday May 29, 2015 @11:30AM (#9625159)
Do you have stats on how many users left the page when shown that prompt?
Re:F*** those popups – signing up those who deserve it by gk1 on Friday May 29, 2015 @11:44AM (#9625267)
I don't. I can find out but not going to bother right now.

As mentioned elsewhere in this thread, I'm not so concerned about people who left. If a small popup is enough to make them leave, then they weren't interested enough in the article to begin with. But still, if I find that the less-invasive method is just as effective then I'll be happy.