News for hackers. Stuff that matters.
Re:Forget privacy: you're terrible at targeting anyway (2019) by danShumway on Monday August 30, 2021 @04:14PM (#28360369)
> The fact that their "post-sales targeting" can overwhelm other advertisers who are just doing "market expansion" targeting doesn't tell you much at all

It shows me that the simplistic method of "advertise to people who have already bought our product" performs vastly better than any of the other sophisticated targeting that advertisers like to tout.

To clarify -- I'm not talking about the proportion of an individual company's budget -- I'm talking about the proportion of the overall market for that product. Every time that someone is shown an ad, that ad is the result of a bidding war. If a large proportion of those ads are retargeted that means the market has decided that the vast majority of advertisers are less confident about their targeting systems then they are about a simplistic, vaguely annoying heuristic.

We can make an assumption about the market as a whole because we believe that the market is at least somewhat efficient. If advanced, targeted advertising that used tons of demographic data and personal information was competitive with these naive targeting techniques, then a higher proportion of those ads would outbid retargeted ads on any given page.

> doesn't tell you much at all

I also want to broaden out a little bit here. In the OP's article, the main complaint being made is not that advertising has zero ROI (although the author is critical of the effectiveness as well). The criticism is that the ads provide no benefit to the user, that they're annoying and reductionist, and that they fail to live up to the promises of companies like Facebook that claim targeted ads connect people to new products that they'll love.

Independent of whether or not we can be critical of the effectiveness of ads for companies, the proportion of retargeted ads also tells us that advertisers broadly, as a market, are incapable of delivering on their promises to consumers and are incapable of building a system that is mutually beneficial to both companies and consumers.

See also some of the authors criticism of recommendation algorithms, which fall into the same boat. Who cares if Netflix's recommendation algorithm increases clicks? Consumers don't sign up for Netflix out of charity, they want a system that serves their interests, not just the company's. For advertisers to try and make the case that access to private data is good for consumers, they need to have something to show that's better than this.

Re:Forget privacy: you're terrible at targeting anyway (2019) by tshaddox on Monday August 30, 2021 @04:34PM (#28360575)
> It shows me that the simplistic method of "advertise to people who have already bought our product" performs vastly better than any of the other sophisticated targeting that advertisers like to tout.

Well, yes, it performs better, but only to people who have already bought the product. It's not surprising that this would perform better than whatever sophisticated ML-based targeting system they use over the general population.

> If a large proportion of those ads are retargeted that means the market has decided that the vast majority of advertisers are less confident about their targeting systems then they are about a simplistic, vaguely annoying heuristic.

Again, this isn't surprising, and I don't think it leads to the conclusion you're making. I think you're getting tripped up because you're not considering the denominator here. There's nothing odd about the fact that a single ad impression shown to a recent purchaser of your product would perform better than a single ad impression shown to someone who has never heard of your product (but perhaps is targeted using something more sophisticated based on their Internet traffic). It's also not odd that the ad publisher would pay a lot more for the former impression than the latter impression (and thus recent purchasers would see a lot of the former type). What's important to note is that the ad publisher is most likely showing orders of magnitude more impressions of the latter type than of the former.

Re:Forget privacy: you're terrible at targeting anyway (2019) by danShumway on Monday August 30, 2021 @07:17PM (#28362082)
> It's not surprising

I'm not sure we're disagreeing?

It's not surprising, but it does show that the sophisticated ML-based targeting system is less effective then promised. That doesn't really need to be a shocking conclusion, but it does generally support what the author says in the linked article. We seem to be agreeing on that point, it's not surprising that retargets outperform any sophisticated model, and the only reason it's worth bringing up is that all of this data collection has been sold to consumers based on the idea that it was going to be a wildly effective revolution in how products got sold, and that pervasive data collection was the only way that revolution could work.

I still want to loop back around to the idea that advertising is itself sold to consumers as a social benefit. A non-surprising outcome that shows lots of people terribly targeted ads but manages to increase ROI is still not delivering on that consumer promise, and it's not clear why consumers should be willing to give up their private data to support that kind of a system.

> What's important to note is that the ad publisher is most likely showing orders of magnitude more impressions of the latter type than of the former.

For each individual publisher, sure, I guess... but again, I'm talking about the market overall. If the majority of ads that most people are seeing are retargets, then that says something about the market. The denominator is all of the ads being seen across the entire market, not the ads that each individual company is showing.

I'm having a really hard time following your math. I actually got curious enough about this that I threw together a couple of programmed simulations, and maybe I'm modeling the system wrong, but I can't get the math the work out in your favor for any of them. If the average company is only sending out 10% retargets, then across the entire market the average consumer should only see 10% retargets. There could be a lot of variance, but it can't be a common experience -- it has to eventually even out when you look at the market overall.

In other words, if there are actually orders of magnitude more ads going out to new users who are unfamiliar with the products being advertised, then some users should be getting all of these ads for new products. So if everyone in the room notices retargets to this degree (and in my experience this is an extremely common sentiment among people when you talk to them about ads) -- then where are the orders of magnitude of other impressions going? Who is seeing them? Those ads can't be going into the void, there should be some people jumping into these conversations saying "I rarely get retargets, most of my ads are for new things."

Unless you want to try and make the point that it's all just a Baader–Meinhof phenomenon and we don't have a lot of retargeted ads in the first place. But I think that's a very different argument than "keep the denominator in mind."

On the note of Baader-Meinhof phenomenons, I do want to again keep referring back to a consumer point-of-view in this conversation, because the article is specifically about the consumer experience and whether these ad targeting systems have any benefit for consumers. It's worth noting that a system where consumers only see 10% of their ads as constant retargets for things they already have bought might still be too repetitive for them. I think it's hard to get away from the fact that complaining about retargets is extremely common, so independent of everything else, we know the system is targeting those people too much simply because they notice it and dislike it. It may increase ROI for the company, but (again) the question is why consumers should consent to give up their privacy for systems that seem to be annoying them. ROI is not a good enough reason for me to give up my privacy, this isn't a charity. And you don't need >50% retargets to hit that threshold of annoyance where the system can be judged bad, it just needs to be a big enough percentage that consumers notice it and get irritated about it.

Re:Forget privacy: you're terrible at targeting anyway (2019) by tshaddox on Monday August 30, 2021 @07:46PM (#28362323)
> It's not surprising, but it does show that the sophisticated ML-based targeting system is less effective then promised.

We agree that it isn't surprising, but I don't think this says almost anything at all about how sophisticated or effective the systems are that target the general population who has probably not heard of your product. That would be like walking into a furniture store, and when a salesperson approaches you to attempt to sell you something, you conclude that their ML-targeted online ad campaigns must not be effective. There is no evidence whatsoever that their online ad campaigns aren't effective for targeting the audience they intend to target. You're being targeted by a different type of advertising not because online ads didn't work, but because you happen to be in a tiny cohort of people currently standing inside a store, and therefore can be targeted using a much less sophisticated system.

> I still want to loop back around to the idea that advertising is itself sold to consumers as a social benefit.

I certainly don't believe that advertising is necessarily a social benefit, but that isn't relevant to the point I'm making, which is about the effectiveness of ads from the ad publisher's perspective.

> For each individual publisher, sure, I guess... but again, I'm talking about the market overall. If the majority of ads that most people are seeing are retargets, then that says something about the market.

But you haven't mentioned any evidence or observations about the market overall. The fact that you receive mattress ads after buying a mattress online tells you essentially nothing about the entire market. I suspect it's unlikely that the majority of ads that most people see are retargets (although even if they are, that still doesn't contradict the point I'm making).

> If the average company is only sending out 10% retargets, then across the entire market the average consumer should only see 10% retargets.

The key here is that the distribution of ad impressions shown to each person probably has extremely high variance, and a very high portion of impressions probably cannot be identified with a valuable retargetable online purchase. If you frequently see a large portion of retargets you are probably nowhere near the average.

> Unless you want to try and make the point that it's all just a Baader–Meinhof phenomenon and we don't have a lot of retargeted ads in the first place.

Indeed, I did make that point somewhere in this thread. I also suspect a significant portion of the complaints about retargeted ads are due to frequency illusion. But even if that's not the case, my argument still applies.

Re:Forget privacy: you're terrible at targeting anyway (2019) by danShumway on Monday August 30, 2021 @09:52PM (#28363124)
> The fact that you receive mattress ads after buying a mattress online tells you essentially nothing about the entire market. I suspect it's unlikely that the majority of ads that most people see are retargets (although even if they are, that still doesn't contradict the point I'm making).

There's two ideas rolled up in here:

One, is like you mention elsewhere, the Baadar-Meinhof phenomenon where you suggest that people don't actually see as many targeted ads as they think. I'm not going to debate that, I don't have the stats to debate it, you could very well be right on that point. Maybe people do just overestimate the number of repeats they see, and the reality is that retargeted ads are a minority of ads online.

The second idea though is more confusing to me: if I buy a mattress and 50% of the ads I see are for that mattress, and I know that in order to get those ads delivered to me a (reasonably) efficient market had to decide that 50% of the time, the ROI on repeated mattress ads were higher than literally any other ad I could have been shown instead (because the mattress ads were willing to outbid them) then that scenario does say that the market believes that the retargeting is more effective than 50% of the other ads I could have been shown.

The difference here is that when I walk into a furniture store, I'm not actively being advertised to by competitors. In order for the retargeted ads to reach me, the company needs to decide that it's willing to outbid the other advertisers currently bidding to sell me an ad. It's not a separate environment with separate rules, the retargeting is happening in the same place as all of the other advertising.

Honestly, I assume that if other companies had the ability to have a salesperson walk up to me when I entered a mattress store and advertise to me on a competing store -- I think they'd probably jump at that opportunity. So I don't think it's a great analogy here, because in the online advertising space they can do that, they can outbid the other company and place their own ads. So we need to ask why they're not doing that more often.

The variance doesn't really change that either (again, unless you're claiming Baadar-Meinhof). Because if the majority of my experience online is actually retargeted and/or naively targeted ads, then what the market is saying is that in the majority of cases, retargeted/naive ads are worth bidding more on than sophisticated ML-targeted ads, regardless of whether there are some occasional periods of variance that tip in the other direction.

What I'm saying is that I'm not convinced the sophisticated ads are performing better than the naive approaches, because from what I can see, the majority of the ads are using the naive approaches. If that is the case, then from that we need to either conclude that the bidding process for ads is not an efficient market, or we need to conclude that sophisticated targeting is rarely more effective than the naive approaches.

Or again... if the argument is that retargeted ads are not a majority, that would also be a reasonable claim to make. But it's got to be one of those 3 things.

----

Separately, I would claim that in a way the ROI and raw numbers matter a lot less than the consumer's subjective experiences, because I don't think the argument about whether privacy-invasive ads are 'good' can be separated from the consumer impact. But I do recognize that's not the point you're making, so I don't want to double down on that and argue at you about something unrelated.

Re:Forget privacy: you're terrible at targeting anyway (2019) by tshaddox on Tuesday August 31, 2021 @02:18AM (#28364527)
> then that scenario does say that the market believes that the retargeting is more effective than 50% of the other ads I could have been shown.

Yep, and again, that’s because you recently bought a mattress. This is likely not the case for the other 99.99% of people on the internet who have not recently bought a mattress online. Again, you’re mixing up the fact that a particular ad might be more effective for you at a particular time with the conclusion that all retargeting ads must be more effective than all other ads.

> I assume that if other companies had the ability to have a salesperson walk up to me when I entered a mattress store and advertise to me on a competing store -- I think they'd probably jump at that opportunity.

You think that a company that makes flotation devices for dogs would pay a full time salesperson to stand just outside the furniture store to make a pitch to you, given almost no data about your interest in dog life preservers? And likewise for the hundreds of thousands of other products in the world? Clearly that’s not the case. It’s very expensive to hire a salesperson, so you’re only going to see salespeople in places where they are likely to be very effective. If there were hypothetically an auction for the salesperson at that location, its almost certain that the furniture store would bid the highest.