The two sides see "off target" quite differently. If the baseline is 0.1% accuracy, and an ad platform offers 1% accuracy, then you see relevant ads showing up at 1 in a 100 rates rather than 1 in a 1,000 rates. You still feel like you're being spammed by useless nonsense. As an advertiser, my cost to reach my audience just dropped by 90%.
I'm really curious how those happen.
At one point it was sure that I was female (am not, have never been) too.... to their credit they figured it out after a year or so, but man the ads. But that was at least a limited run of confusion.
But probably the truth is that these systems aren’t that good :)
Funnily enough when I'm discussing the dangerous nature of large datasets in the hands of companies/bad actors (sometimes the one and the same...) and the "creepy" effects this is one of the examples I use, I've found that if you know a little about the person and couch the argument in a way they can personally respond to, they understand even if they don't know the first thing about technology generally.
EDIT: https://www.forbes.com/sites/kashmirhill/2012/02/16/how-targ... for anyone who hasn't seen it.
For example they may show you an ads about hairdryers after you searched for computer keyboards. There is absolutely no relationship between the two, but Google doesn't know it yet, so they try. After all, there may be a correlation. In the likely event where there isn't, Google will simply stop showing hairdryer ads and show you computer mice instead (a known correlation) or running shoes (another experiment).
But the ads I see are way off target.
Hell Google's news ... AI or whatever they're doing has been absolutely convinced I'm a Nebraska Cornhuskers fan, probabbly because my team plays them and I google something about them once in a while.... but in the past even when I told Google directly "I don't want to see stories about Nebraska Cornhuskers" ... after a while it again becomes convinced I'm a huge Cornhuskers fan.
I'm just not sure these systems are ... that effective.
Not to say it is easy, the systems have to be really complex / interesting.