Re:What do we really know about the effectiveness of digital...
by viraptor on Wednesday November 06, 2019 @06:25PM
(#21468707)
How do you separate "people who haven't seen an ad" into a group in Google analytics? I don't believe "organic" source does that, because that means they weren't targeted by the ad in the first place, creating a bias.
[ Parent
| on HN ]
Re:What do we really know about the effectiveness of digital...
by MichaelBurjack on Wednesday November 06, 2019 @07:07PM
(#21469026)
Advertisers have many tools to measure "ghost ads" aka "people who haven't seen an ad but would otherwise have qualified for all your target criteria". See https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2620078 as an example.
Re:What do we really know about the effectiveness of digital...
by viraptor on Wednesday November 06, 2019 @07:14PM
(#21469081)
That's of course possible to measure in theory. I meant it as a response to "Facebook, Google and others make these tests possible in their platforms" since I haven't seen it exposed as an explicit option on either.
Re:What do we really know about the effectiveness of digital...
by MichaelBurjack on Wednesday November 06, 2019 @07:19PM
(#21469113)
Then you haven't been talking to the right ad sales teams. Google and Facebook have entire product options built around this specific concept. You can run a "ghost ads" test on Google for as little as $20k in ad spend; it's relatively accessible even for smaller players.
Re:What do we really know about the effectiveness of digital...
by jsonne on Wednesday November 06, 2019 @11:05PM
(#21470294)
For Facebook, Reach ads have a brand lift objective that will estimate for you. If you spend large amounts they have a measurement team that will run the actual study for you. Source: I'm running one right now for a CPG brand.
Re:What do we really know about the effectiveness of digital...
by jefftk on Thursday November 07, 2019 @08:10AM
(#21472819)
You can run this yourself without any help from them: show one group ads for your site, and show another group white rectangles. Compare performance.
Re:What do we really know about the effectiveness of digital...
by newtothebay on Wednesday November 06, 2019 @08:22PM
(#21469524)
Facebook has this exactly this tool, aka Conversion / Brand Lift [1]. It's a real experimentation system, not a "simulated" one like Google's Ghost Ad.
Re:What do we really know about the effectiveness of digital...
by kposehn on Wednesday November 06, 2019 @08:47PM
(#21469655)
Yep. Lift tests are solid gold. A lot of people pan FB ads but the reality is they can be very incremental.
The flip side is that not every campaign, targeting strategy or ad will be incremental. You have to test and retest your way to it. A blanket assumption won’t work.
Re:What do we really know about the effectiveness of digital...
by kevinventullo on Wednesday November 06, 2019 @06:44PM
(#21468855)
Off the top of my head, you could do geographic bucketing. Take say 100 cities, and only run ads in 50 of them.
Re:What do we really know about the effectiveness of digital...
by kposehn on Wednesday November 06, 2019 @08:49PM
(#21469666)
Geo tests are useful for sure, but also require a lot of data to get statistically significant results. Any noise in your data (seasonality, PR, etc) has to be taken into account as well. They’re harder to execute in general but can work well.
Re:What do we really know about the effectiveness of digital...
by dredmorbius on Wednesday November 06, 2019 @09:58PM
(#21469996)
The interest is more on markets than individuals, in general, so what you're measuring is market response given advertising exposure, or more critically, ROI given spend.
The fact that Web and AdTech allow the appearance of individual-level targeting does not necessarily make that a Good Thing.