News for hackers. Stuff that matters.
Re:Forget privacy: you're terrible at targeting anyway (2019) by danShumway on Monday August 30, 2021 @12:30PM (#28357422)
> Why do you assume so strongly that they're not doing both.

That's a good question. I guess I do assume they're doing both, but the extreme degree to which they lean on repeat targeting, to the point where it's this noticeable, and to the point where repeat targeting overwhelms other advertisers to this degree, still means that they're incredibly bad at expanding their market.

Let's look at Youtube again. Youtube can both recommend new videos and old videos. It can do both at the same time. But if the majority of my feed is recommending repeat videos, that signifies to me that they're not very confident about the main part I care about as a consumer: showing me knew things.

Looking back at what OP says in the linked article:

> I don't mind letting your programs see my private data as long as I get something useful in exchange. But that's not what happens.

> the dirty secret of the machine learning movement: almost everything produced by ML could have been produced, more cheaply, using a very dumb heuristic you coded up by hand, because mostly the ML is trained by feeding it examples of what humans did while following a very dumb heuristic. There's no magic here.

I still don't think it's all that impressive to increase ROI using this kind of simplistic heuristic. More than that, I don't think it justifies the incredibly large amount of money and infrastructure that gets devoted to ad targeting online. If some of the most prominent parts of a gigantic system can be replicated by a couple of purchasing history lookups in a database.

It would be impressive for them to increase advertising ROI in a way that increases value for consumers, or that justifies the tracking mechanisms or the extensive research and AI poured into the system, or in a way that is giving better ROI than ridiculously naive approaches, but repeat targeting doesn't seem to do any of that as far as I can tell.

TLDR I assume they're trying to do both, but the proportion of repeat advertising indicates to me that it's giving them a lot better results than more sophisticated methods, which (to me) indicates that their sophisticated methods are all bad. If better targeting methods existed, repeat targeting wouldn't be so prominent and obvious because it would be getting crowded out by other targeting techniques.

Re:Forget privacy: you're terrible at targeting anyway (2019) by mountainb on Monday August 30, 2021 @12:43PM (#28357631)
No one thinks that showing the same ad to the same person 100 times is effective. It does, however, make more money for the ad seller for ad customers to waste spending.

Much of ad targeting is not automatic, but manually configured by advertisers in one way or another. Many of these users manually configure their ads poorly. If I tell the system "show this ad to everyone in this geography with no restriction on frequency" the only 'smart' targeting is the stuff that restricts it to users that appear to be in that geography. Everything else is the 'dumb' method specified by the user.

I think also the purely automated methods are not necessarily incented to provide better targeting for the ad buyer. Their incentive is to spend all the budget and to try to get the user to refill the budget. For large sectors of this spending, there isn't that much sensitivity to waste so long as the people responsible for wasting the money don't lose their jobs. You wouldn't believe it just as an ordinary smart person but people do waste billions of dollars a year on this stuff. The 'smarts' of the system is dedicated to parting fools from their money repeatedly while giving them enough justification with 'greedy' attribution metrics to keep filling up the budget.

Re:Forget privacy: you're terrible at targeting anyway (2019) by nobody9999 on Monday August 30, 2021 @06:27PM (#28361647)
>No one thinks that showing the same ad to the same person 100 times is effective.

That depends on what you consider "effective" advertising. Keeping a brand in your (and others') face is a key goal of advertising.

In fact, two (of many) of those goals for advertisers are "top-of-mind awareness"[0]:

   In marketing, "top-of-mind awareness" refers to a
   brand or specific product being first in 
   customers' minds when thinking of a particular 
   industry or category.
and "unaided awareness"[1]:

   Brand recall is also known as unaided recall or 
   spontaneous recall and refers to the ability of 
   the consumer to correctly generate a brand from 
   memory when prompted by a product category.
[0] https://en.wikipedia.org/wiki/Top-of-mind_awareness

[1] https://en.wikipedia.org/wiki/Brand_awareness

Re:Forget privacy: you're terrible at targeting anyway (2019) by mountainb on Tuesday August 31, 2021 @09:36AM (#28367892)
That's not how it works. You are supposed to cycle creative to prevent people from going 'ad blind.' People tune out creative they have seen too many times. Any book on advertising, any of the best practices documentation provided by Google, FB, or other ad sellers, all of them will support the practice of cycling creative, even if the variations are minor. Think of Budweiser cycling the 'Wazzap' joke in the 90s/2000s through variations on the commercial.
Re:Forget privacy: you're terrible at targeting anyway (2019) by nobody9999 on Tuesday August 31, 2021 @07:35PM (#28374899)
Yours is a good point.

It's orthogonal to mine, however. I noted the importance of brand awareness, not specific ad awareness. There's miles of difference between those and nothing I said isn't consistent with "cycling creative."

Re:Forget privacy: you're terrible at targeting anyway (2019) by pixl97 on Monday August 30, 2021 @03:55PM (#28360163)
>No one thinks that showing the same ad to the same person 100 times is effective.

No one told that to Coca-Cola

Re:Forget privacy: you're terrible at targeting anyway (2019) by tshaddox on Monday August 30, 2021 @04:02PM (#28360234)
> I guess I do assume they're doing both, but the extreme degree to which they lean on repeat targeting, to the point where it's this noticeable, and to the point where repeat targeting overwhelms other advertisers to this degree, still means that they're incredibly bad at expanding their market.

> TLDR I assume they're trying to do both, but the proportion of repeat advertising indicates to me that it's giving them a lot better results than more sophisticated methods

I don't think you can conclude anything about how they are "leaning" or what "proportion" of their ad budget is being spent on different things, if the only evidence you have is the portion of ads shown to you.

The fact that their "post-sales targeting" can overwhelm other advertisers who are just doing "market expansion" targeting doesn't tell you much at all, because the number of people who would be eligible for post-sales targeting would obviously be vastly smaller than the number of people eligible for market expansion targeting. It seems very reasonable that the company you just spent hundreds of dollars at would be willing to bid more for an ad on your timeline than the thousands of other companies who want to show you an ad about something you've never heard of.

Re:Forget privacy: you're terrible at targeting anyway (2019) by danShumway on Monday August 30, 2021 @04:14PM (#28360369)
> The fact that their "post-sales targeting" can overwhelm other advertisers who are just doing "market expansion" targeting doesn't tell you much at all

It shows me that the simplistic method of "advertise to people who have already bought our product" performs vastly better than any of the other sophisticated targeting that advertisers like to tout.

To clarify -- I'm not talking about the proportion of an individual company's budget -- I'm talking about the proportion of the overall market for that product. Every time that someone is shown an ad, that ad is the result of a bidding war. If a large proportion of those ads are retargeted that means the market has decided that the vast majority of advertisers are less confident about their targeting systems then they are about a simplistic, vaguely annoying heuristic.

We can make an assumption about the market as a whole because we believe that the market is at least somewhat efficient. If advanced, targeted advertising that used tons of demographic data and personal information was competitive with these naive targeting techniques, then a higher proportion of those ads would outbid retargeted ads on any given page.

> doesn't tell you much at all

I also want to broaden out a little bit here. In the OP's article, the main complaint being made is not that advertising has zero ROI (although the author is critical of the effectiveness as well). The criticism is that the ads provide no benefit to the user, that they're annoying and reductionist, and that they fail to live up to the promises of companies like Facebook that claim targeted ads connect people to new products that they'll love.

Independent of whether or not we can be critical of the effectiveness of ads for companies, the proportion of retargeted ads also tells us that advertisers broadly, as a market, are incapable of delivering on their promises to consumers and are incapable of building a system that is mutually beneficial to both companies and consumers.

See also some of the authors criticism of recommendation algorithms, which fall into the same boat. Who cares if Netflix's recommendation algorithm increases clicks? Consumers don't sign up for Netflix out of charity, they want a system that serves their interests, not just the company's. For advertisers to try and make the case that access to private data is good for consumers, they need to have something to show that's better than this.

Re:Forget privacy: you're terrible at targeting anyway (2019) by tshaddox on Monday August 30, 2021 @04:34PM (#28360575)
> It shows me that the simplistic method of "advertise to people who have already bought our product" performs vastly better than any of the other sophisticated targeting that advertisers like to tout.

Well, yes, it performs better, but only to people who have already bought the product. It's not surprising that this would perform better than whatever sophisticated ML-based targeting system they use over the general population.

> If a large proportion of those ads are retargeted that means the market has decided that the vast majority of advertisers are less confident about their targeting systems then they are about a simplistic, vaguely annoying heuristic.

Again, this isn't surprising, and I don't think it leads to the conclusion you're making. I think you're getting tripped up because you're not considering the denominator here. There's nothing odd about the fact that a single ad impression shown to a recent purchaser of your product would perform better than a single ad impression shown to someone who has never heard of your product (but perhaps is targeted using something more sophisticated based on their Internet traffic). It's also not odd that the ad publisher would pay a lot more for the former impression than the latter impression (and thus recent purchasers would see a lot of the former type). What's important to note is that the ad publisher is most likely showing orders of magnitude more impressions of the latter type than of the former.

Re:Forget privacy: you're terrible at targeting anyway (2019) by danShumway on Monday August 30, 2021 @07:17PM (#28362082)
> It's not surprising

I'm not sure we're disagreeing?

It's not surprising, but it does show that the sophisticated ML-based targeting system is less effective then promised. That doesn't really need to be a shocking conclusion, but it does generally support what the author says in the linked article. We seem to be agreeing on that point, it's not surprising that retargets outperform any sophisticated model, and the only reason it's worth bringing up is that all of this data collection has been sold to consumers based on the idea that it was going to be a wildly effective revolution in how products got sold, and that pervasive data collection was the only way that revolution could work.

I still want to loop back around to the idea that advertising is itself sold to consumers as a social benefit. A non-surprising outcome that shows lots of people terribly targeted ads but manages to increase ROI is still not delivering on that consumer promise, and it's not clear why consumers should be willing to give up their private data to support that kind of a system.

> What's important to note is that the ad publisher is most likely showing orders of magnitude more impressions of the latter type than of the former.

For each individual publisher, sure, I guess... but again, I'm talking about the market overall. If the majority of ads that most people are seeing are retargets, then that says something about the market. The denominator is all of the ads being seen across the entire market, not the ads that each individual company is showing.

I'm having a really hard time following your math. I actually got curious enough about this that I threw together a couple of programmed simulations, and maybe I'm modeling the system wrong, but I can't get the math the work out in your favor for any of them. If the average company is only sending out 10% retargets, then across the entire market the average consumer should only see 10% retargets. There could be a lot of variance, but it can't be a common experience -- it has to eventually even out when you look at the market overall.

In other words, if there are actually orders of magnitude more ads going out to new users who are unfamiliar with the products being advertised, then some users should be getting all of these ads for new products. So if everyone in the room notices retargets to this degree (and in my experience this is an extremely common sentiment among people when you talk to them about ads) -- then where are the orders of magnitude of other impressions going? Who is seeing them? Those ads can't be going into the void, there should be some people jumping into these conversations saying "I rarely get retargets, most of my ads are for new things."

Unless you want to try and make the point that it's all just a Baader–Meinhof phenomenon and we don't have a lot of retargeted ads in the first place. But I think that's a very different argument than "keep the denominator in mind."

On the note of Baader-Meinhof phenomenons, I do want to again keep referring back to a consumer point-of-view in this conversation, because the article is specifically about the consumer experience and whether these ad targeting systems have any benefit for consumers. It's worth noting that a system where consumers only see 10% of their ads as constant retargets for things they already have bought might still be too repetitive for them. I think it's hard to get away from the fact that complaining about retargets is extremely common, so independent of everything else, we know the system is targeting those people too much simply because they notice it and dislike it. It may increase ROI for the company, but (again) the question is why consumers should consent to give up their privacy for systems that seem to be annoying them. ROI is not a good enough reason for me to give up my privacy, this isn't a charity. And you don't need >50% retargets to hit that threshold of annoyance where the system can be judged bad, it just needs to be a big enough percentage that consumers notice it and get irritated about it.

Re:Forget privacy: you're terrible at targeting anyway (2019) by tshaddox on Monday August 30, 2021 @07:46PM (#28362323)
> It's not surprising, but it does show that the sophisticated ML-based targeting system is less effective then promised.

We agree that it isn't surprising, but I don't think this says almost anything at all about how sophisticated or effective the systems are that target the general population who has probably not heard of your product. That would be like walking into a furniture store, and when a salesperson approaches you to attempt to sell you something, you conclude that their ML-targeted online ad campaigns must not be effective. There is no evidence whatsoever that their online ad campaigns aren't effective for targeting the audience they intend to target. You're being targeted by a different type of advertising not because online ads didn't work, but because you happen to be in a tiny cohort of people currently standing inside a store, and therefore can be targeted using a much less sophisticated system.

> I still want to loop back around to the idea that advertising is itself sold to consumers as a social benefit.

I certainly don't believe that advertising is necessarily a social benefit, but that isn't relevant to the point I'm making, which is about the effectiveness of ads from the ad publisher's perspective.

> For each individual publisher, sure, I guess... but again, I'm talking about the market overall. If the majority of ads that most people are seeing are retargets, then that says something about the market.

But you haven't mentioned any evidence or observations about the market overall. The fact that you receive mattress ads after buying a mattress online tells you essentially nothing about the entire market. I suspect it's unlikely that the majority of ads that most people see are retargets (although even if they are, that still doesn't contradict the point I'm making).

> If the average company is only sending out 10% retargets, then across the entire market the average consumer should only see 10% retargets.

The key here is that the distribution of ad impressions shown to each person probably has extremely high variance, and a very high portion of impressions probably cannot be identified with a valuable retargetable online purchase. If you frequently see a large portion of retargets you are probably nowhere near the average.

> Unless you want to try and make the point that it's all just a Baader–Meinhof phenomenon and we don't have a lot of retargeted ads in the first place.

Indeed, I did make that point somewhere in this thread. I also suspect a significant portion of the complaints about retargeted ads are due to frequency illusion. But even if that's not the case, my argument still applies.

Re:Forget privacy: you're terrible at targeting anyway (2019) by danShumway on Monday August 30, 2021 @09:52PM (#28363124)
> The fact that you receive mattress ads after buying a mattress online tells you essentially nothing about the entire market. I suspect it's unlikely that the majority of ads that most people see are retargets (although even if they are, that still doesn't contradict the point I'm making).

There's two ideas rolled up in here:

One, is like you mention elsewhere, the Baadar-Meinhof phenomenon where you suggest that people don't actually see as many targeted ads as they think. I'm not going to debate that, I don't have the stats to debate it, you could very well be right on that point. Maybe people do just overestimate the number of repeats they see, and the reality is that retargeted ads are a minority of ads online.

The second idea though is more confusing to me: if I buy a mattress and 50% of the ads I see are for that mattress, and I know that in order to get those ads delivered to me a (reasonably) efficient market had to decide that 50% of the time, the ROI on repeated mattress ads were higher than literally any other ad I could have been shown instead (because the mattress ads were willing to outbid them) then that scenario does say that the market believes that the retargeting is more effective than 50% of the other ads I could have been shown.

The difference here is that when I walk into a furniture store, I'm not actively being advertised to by competitors. In order for the retargeted ads to reach me, the company needs to decide that it's willing to outbid the other advertisers currently bidding to sell me an ad. It's not a separate environment with separate rules, the retargeting is happening in the same place as all of the other advertising.

Honestly, I assume that if other companies had the ability to have a salesperson walk up to me when I entered a mattress store and advertise to me on a competing store -- I think they'd probably jump at that opportunity. So I don't think it's a great analogy here, because in the online advertising space they can do that, they can outbid the other company and place their own ads. So we need to ask why they're not doing that more often.

The variance doesn't really change that either (again, unless you're claiming Baadar-Meinhof). Because if the majority of my experience online is actually retargeted and/or naively targeted ads, then what the market is saying is that in the majority of cases, retargeted/naive ads are worth bidding more on than sophisticated ML-targeted ads, regardless of whether there are some occasional periods of variance that tip in the other direction.

What I'm saying is that I'm not convinced the sophisticated ads are performing better than the naive approaches, because from what I can see, the majority of the ads are using the naive approaches. If that is the case, then from that we need to either conclude that the bidding process for ads is not an efficient market, or we need to conclude that sophisticated targeting is rarely more effective than the naive approaches.

Or again... if the argument is that retargeted ads are not a majority, that would also be a reasonable claim to make. But it's got to be one of those 3 things.

----

Separately, I would claim that in a way the ROI and raw numbers matter a lot less than the consumer's subjective experiences, because I don't think the argument about whether privacy-invasive ads are 'good' can be separated from the consumer impact. But I do recognize that's not the point you're making, so I don't want to double down on that and argue at you about something unrelated.

Re:Forget privacy: you're terrible at targeting anyway (2019) by tshaddox on Tuesday August 31, 2021 @02:18AM (#28364527)
> then that scenario does say that the market believes that the retargeting is more effective than 50% of the other ads I could have been shown.

Yep, and again, that’s because you recently bought a mattress. This is likely not the case for the other 99.99% of people on the internet who have not recently bought a mattress online. Again, you’re mixing up the fact that a particular ad might be more effective for you at a particular time with the conclusion that all retargeting ads must be more effective than all other ads.

> I assume that if other companies had the ability to have a salesperson walk up to me when I entered a mattress store and advertise to me on a competing store -- I think they'd probably jump at that opportunity.

You think that a company that makes flotation devices for dogs would pay a full time salesperson to stand just outside the furniture store to make a pitch to you, given almost no data about your interest in dog life preservers? And likewise for the hundreds of thousands of other products in the world? Clearly that’s not the case. It’s very expensive to hire a salesperson, so you’re only going to see salespeople in places where they are likely to be very effective. If there were hypothetically an auction for the salesperson at that location, its almost certain that the furniture store would bid the highest.