I actually don't care about ads. I use an ad-blocker because I am concerned about everybody in the industry tries to track and profile me.
I share your dislike of tracking and profiling.
Ad measurement companies have no incentive to accurately report the incremental sales (i.e., that which would not have happened, had the ad not aired) of the ad they are measuring. Why not? Because their clients, the marketing function at the advertiser, don't get their bonuses paid based on the accuracy of the measurement firm's work product. They get their bonuses (and ultimately salary) based on the success of their marketing efforts. If a company like mine reports that an ad on TikTok for Dran-o didn't sell any Dran-o that wouldn't have been sold anyway, Dran-o's marketers will just find a different ad measurement company.
Furthermore, as a platform, TikTok has to prove to potential advertisers that TikTok is a good platform on which to place ads. So TikTok also has no incentive for accurate measurement.
So, what does a company like mine do? Juice the numbers. Because the company leadership is judged not on accuracy of measurement, but profit.
It's a lot like the bond rating agencies that lead, in part, to the 2008 housing crisis, getting paid by the people whose homework they were grading.
This is an entirely true story, btw. Apparently if you advertise Dran-o to kids on TikTok, you get something north of a $2.00 ROI. Completely ridiculous.
In another anecdote, we measure advertising on YouTube. Google would only let us implement changes to our measurement software if they "improved" the software. (Again, I don't mean accuracy. Neither did Google.)
How do you solve this? Well, you can start by letting the CFO at the advertiser own the ad measurement responsibility. The CFO actually has incentive to understand if the marketers are just pissing away money. The shareholders do too.
Perhaps there's also room for an industry watchdog, paid for by advertising platforms and advertisers, that certified the practices of measurement companies?
Anyway, shareholders are getting fleeced. All so the Valley can rake in beaucoup bucks at the expense of shareholders. With the added benefit of a layer of surveillance apparatus suffusing the internet.
Fun times!
There's actually a lot of scholarship on how advertising's effects are a lot lower than the ad measurement and advertising industry thinks they are. (Go figure that the people who profit from advertising think it works.) Freakonomics Radio episodes 440 and 441 are a good place to start, for those who are interested.
When your solutions are "juicing the numbers" how are they addressing the miscorrelation between third party tracking tools for both impressions and clicks on the platforms, but also what would come through in analytics in the site or app?
Without once mentioning a pixel and how that all works, you claim that numbers are being inflated, how so? Are you talking about over-reporting, mostly caused by impression conversions?
If you are "getting a $2 ROI showing Dran-O ads to kids on TikTok" there have to be sales occurring in the first place in order for TikTok to claim credit for them.
Can you also go into more detail about what tracking solution for YouTube you needed to contact Google about? That is confusing to me.
I've been in the ad world for almost 8 years now. If a platform is over-reporting conversions I have other ways to audit that.
If you look at a distribution or histogram of ROIs from our thousands of studies, you will see that it approximates a gaussian distribution...right up until the left hand side hits $1.00, where it looks like the distribution hit a brick wall.
Same thing for a distribution of incremental lifts, except that the brick wall is right above 0% lift.
It's a discontinuity that shouldn't exist, like the Polish high school exit exams. See if you can guess what the minimum score to pass* was:
Except, unlike that distribution, there is virtually nothing to the left of the discontinuity at my company.
Without talking about the tech behind it, what I can say is that the fraud is not occurring on the impressions and tracking side. It's in the statistical tools that infer the incrementality of the purchasing behavior. Seriously, I urge you to listen to the Freakonomics episodes I mentioned.
*The minimum score was 30. This is pretty damning evidence that teachers were juicing the tests of kids who filed by one or two questions.
I think this is probably where you get the room to juice the numbers like this. If you were tracking online conversions, people would easily be able to compare with an incrementality study run by the provider (say Google) and see that you are lying/wrong.
I can see how you would have that perspective as a third-party analyst of conversion.
It's actually easy to do if you are the exchange/sell-side provider of the advertising space. In your logic, where the advertiser running the incrementality study would have won the auction, just randomly remove their bid from some won auctions, have the second highest bidder win, and then track that user as the "control" for conversion purposes vs. users you did display the ad to. Voilà!
That's not observation. That's statistical inference. I am referring, strictly, to direct, empiricial observation. With any kind of statistical inference, you get into a pissing match about assumptions, model quality, etc... Is the "control" a good stand-in for the behavior of the "test", etc.
Incrementality is able to be estimated, but unobservable. And therein lies the potential for fraud.
You can observe the results of the experiment and then make statistical inference about the "true" incrementality. You don't even have to perform inference necessarily, you can just provide the direct results of your experiment to the advertiser and let them do the inference.
But I do fail to see how a third-party could possibly infer this measure, given that they have no capacity to do a true incrementality experiment on the platform.
To riff off the average height example - you can get a pretty darn good estimate based on sampling and good statistical practice... unless the people doing the sampling have a reason to bias the measurement, or - if you're sampling on your own - people who control where you go and who you meet...
I think my usage of "you" was confusing because I work in sell-side advertising.
It is impossible to actually observe what would have happened, had there been no advertisement, because there in fact was an advertisement.
Thus, the estimation of incrementality must be inferred statistically.
I can see how you would have that perspective as a third-party analyst of conversion.
It's actually easy to do if you are the exchange/sell-side provider of the advertising space. In your logic, where the advertiser requesting the incrementality study would have won the auction, just randomly remove their bid from some won auctions, have the second highest bidder win, and then track that user as the "control" for conversion purposes vs. users you did display the ad to. Voilà!
This is how Google in-house incrementality studies are run, for instance.
Frankly the number of dots that have to be connected between different systems in order to make that stuff work is too difficult for me to trust the data. If I'm going to trust a black box, I'm not going to trust programmatic exchanges and attribution vendors. I'm going to trust platforms that have vertical integration at as many stages as possible.
So, Google basically.
I definitely remember asking my mom to buy liquid plumber when I was about 13 because I had a slow drain in a bathroom she never used. I only realized that slow=clogged from the commercials I saw.
As a side note, I must say I feel this conversation took on a negative (and condescending?) tone.
I can confirm that point on a small scale; it's something I repeatedly mentioned on HN for years. I used to work literally next desk to a small social media marketing agency, that spun out of the company I was employed by. I knew the people running that agency, I got to see how they work, even read and commented on the reports they sent to customers.
It was as GP described, with a twist - the people working in said agency weren't exactly good with numbers. They understood, however, the idea that a graph going up and to the right is good. Despite the numbers having little connection to reality, they wrote reports that highlighted how successful their campaigns were. Those reports were read by customers equally proficient in mathematics, and similarly good at tracking sales on their own side. Bottomline: money changed hands, both sides were happy, the whole thing was still completely untethered from reality.
You probably didn't see that ad at the super bowl.
There's a book on this topic that explicitly draws the parallels to the housing market meltdown, "Subprime Attention Crisis." There is also a professor at Columbia, Kinshuk Jerath, who has written explicitly about these misaligned incentives.
Not sure how you get this data if you are not the supplier.
You just mentioned in another comment that the key data needed to measure incrementality is impossible to get, from your perspective. [0]
How do you get the data if you're not a supplier? You contract for the supplier.
Brave is already at 60+ million MAU. It's already 1/4 of the market share from Firefox. Brave's market share is rising, Firefox is declining.
If there is one horse to bet here, it is Brave. Sticking with Firefox is just playing "controlled opposition" right now.
Attempting to convert Firefox users is not a long term strategy, and doesn't do as much or anything to create a better web.
I like Vivaldi on mobile with built in adblocking and some bit of control for text size (aging has not been kind to my eyes, mobile text is too small most of the time). Vivaldi hasn't made it pass evaluation stage on desktop for me as it often crashes when I try it (linux distros).
Browsers are going to continue to be a central part of our OS -- no stopping that. I hope the companies can be taken to task for colluding and that innovation is not stifled.
I happily use Vivaldi on Linux Mint for more than two years without any issues!?
The last time I evaluated it in Fedora (maybe 3 years now?) it was crashing under moderate use, and haven't had time to check recently. Perhaps when some time clears up I should give it another go.
I'm currently using Edge with uBlock Origin Lite. I can't tell the difference between uBO and uBOL. AdGuard MV3 also seems to work fine but I've used uBO so long that I'm sticking to it out of comfort.
That said, I keep Tor installed for as close to perfect privacy as possible. It feels academic though, as everything I do is pretty pedestrian and I generally avoid Google's services. I do prefer Edge to Brave, there's many features that I like here, but it's my backup plan if somehow Edge's adblocking doesn't work as well as it does today.
Even though I don't use it daily, I promote Brave to anyone that would normally be inclined to use Firefox. Otherwise, I push native browsers for all the inherent advantages they have. For me that's Safari on iOS and Edge on Windows. There's no doubt that built-in adblockers like Brave has is the future, they're just ahead of everyone in many ways. For me, Brave is what Firefox should be by now, in all regards.
Now you don't have to abandon Firefox because of their dumb UI decisions anymore.
It would be nice to see innovation in this space but web standards implementation requirements may make that bar too high? I'm not a browser dev, just an armchair techie.
Have you read the blog post by AdGuard about their MV3 adblocker and, specifically, the limitations of that addon compared what we had before?
https://adguard.com/en/blog/adguard-mv3.html
I wouldn't call it "blown things significantly out of proportion", not unless you're okay with compromised ad blocking capabilities, which some people seem to be in the name of security which is oxymoronic.
Large adtech companies are coalescing and supporting a single browser framework that gives them a modicum of control around how adblockers are integrated into the extensions, while also funding directly or indirectly realistic browser competition through Firefox (sorry Brave and Vivaldi... still a ways to go market share-wise). The economist in me thinks there is formal and informal coordination to make this ad "market" exist (no one wants ads, really, they want search engines with relevant results) and there is exercise in market power to the detriment of businesses purchasing advertising (and waste to society writ large).