News for hackers. Stuff that matters.
Re:Insane state of today's advertising part 3 by allanbreyes on Thursday August 31, 2017 @10:08PM (#15145602)
I never quite understood why domain-blocking works so well for ad-blockers. I'm surprised why sites don't just use a reverse proxy or something to serve from those ad domains. What am I missing?
Re:Insane state of today's advertising part 3 by rahimnathwani on Thursday August 31, 2017 @10:26PM (#15145673)
If the ads were static (e.g. advertiser A bought a specific place on one of publisher B's pages, for a month), and advertiser A didn't want independent verification that the ads were seen, then your proposal could be simply implemented.

"What am I missing?"

Many ads are served after real-time auction: whilst your browser is loading and rendering the page, an auction is going between advertisers for the ad spot(s) on the page. The auction happens quickly, but it adds latency. Adding a reverse proxy would add further latency, and would remove the ability for ad networks to properly target ads (e.g. using cookies) and account for impressions.

Re:Insane state of today's advertising part 3 by belorn on Friday September 01, 2017 @03:09AM (#15146719)
Which reveals a problematic truth. The tracking is worth more than getting rid of ad blocking.
Re:Insane state of today's advertising part 3 by rahimnathwani on Friday September 01, 2017 @01:05PM (#15150321)
Or some amount of well-targeted advertising is worth more than a larger amount of poorly-targeted advertising.
Re:Insane state of today's advertising part 3 by kakarot on Thursday August 31, 2017 @10:45PM (#15145732)
Would you mind expanding a bit on this real-time auction thing, like how common it is and what the process looks like, or could you point me in the direction of the sources you used to make that claim?

Thanks!

Re:Insane state of today's advertising part 3 by ChuckMcM on Friday September 01, 2017 @12:12AM (#15146064)
There used to be a great article on Searchengineland about it but I can't find it now. And it was originally patented by GoTo[1] and Google was sued by Overture[2] with mixed results[3]. It did give Yahoo! which owned Overture at the time some Google stock (2.7M shares).[4] (Which, interestingly enough, if they had held would be worth more than $2B today)

[1] https://www.google.com/patents/US6269361

[2] https://www.cnet.com/news/overture-sues-google-over-search-p...

[3] http://www.waltmire.com/2014/06/02/inventor-of-pay-per-click...

[4] http://www.nytimes.com/2004/08/10/business/technology-google...

Re:Insane state of today's advertising part 3 by umeshunni on Friday September 01, 2017 @12:33AM (#15146137)
The ad auctions that happen on Google (and Yahoo etc) are a simpler version of what happens on the web since there's only one publisher (i.e Google) and a single 'ad network' (i.e. AdWords).

On the web, there are multiple publishers, served by multiple ad networks and multiple exchanges (and it's turtles all the way down)

Nowadays, bidding on the web happens through the OpenRTB protocol. See https://www.iab.com/guidelines/real-time-bidding-rtb-project... http://sharethrough.com/guides/programmatic-native/

Re:Insane state of today's advertising part 3 by ChuckMcM on Friday September 01, 2017 @01:59AM (#15146463)
I am constrained by the non-disclosure I signed when I left Google from disclosing how I know this, but I know that the auctions on Google are "not a simpler version" :-).

That said, I think IAB's efforts to make auction priced advertising available to people who don't use Google's ad network is commendable.

Re:Insane state of today's advertising part 3 by beagle3 on Friday September 01, 2017 @09:04AM (#15148000)
AppNexus[0] used to provide RTB to many networks in 2011, including Google and Facebook. Isn't that still the case?

[0] https://en.wikipedia.org/wiki/AppNexus

Re:Insane state of today's advertising part 3 by munchbunny on Thursday August 31, 2017 @10:51PM (#15145749)
If you search for the terms "real time bidding" and "ad exchange", you will find a lot of literature on how it works. The explanation and the technical underpinnings are a bit involved, which is why I'm not just outright explaining here, but you will find explanations pretty readily.
Re:Insane state of today's advertising part 3 by mangoceylon on Thursday August 31, 2017 @11:44PM (#15145963)
If you poke around AppNexus, you will find what you are looking for. The process is basically: a visitor comes to the site, each connected ad network/buyer has 100ms to provide a bid, the top bidder wins.
Re:Insane state of today's advertising part 3 by alkonaut on Friday September 01, 2017 @02:41AM (#15146619)
What happens with ad blocking visitors? They never become a visitor to bid for?

I'd actually like for my ad blocker to download all ads and pretend to download the ad, and give the impression of an impression. That way someone would have made a bid for that impression.

Otherwise what will happen is that as ad blocking use becomes more and more widespread, the ad viewers become fewer but more profitable (Ironically perhaps more profitable on average than the original set of viewers, because adblock users weren't likely to click in the first place).

If ad blocking is to be a way of killing online advertising in its current form, and not just improving the browser experience (and this is what I think should be the goal) then it needs to cheat the ad networks, they can't just pretend the request never happened.

Re:Insane state of today's advertising part 3 by therealidiot on Friday September 01, 2017 @02:59AM (#15146686)
> I'd actually like for my ad blocker to download all ads and pretend to download the ad, and give the impression of an impression. That way someone would have made a bid for that impression.

https://adnauseam.io/

Re:Insane state of today's advertising part 3 by alkonaut on Friday September 01, 2017 @03:08AM (#15146716)
Yeah I don't really think the idea of cheating any further (i.e. fake-clicking the ad) is necessary. I just want to appear like a regular ad-viewing browser that doesn't click ads.
Re:Insane state of today's advertising part 3 by chinathrow on Friday September 01, 2017 @02:45AM (#15146640)
So like your IP, browser version, plugins installed etc etc get leaked to 100s of connected buyers? How is that even remotely legal in certain EU countries?
Re:Insane state of today's advertising part 3 by goodnews3879 on Friday September 01, 2017 @01:00AM (#15146227)
It's called Real Time Bidding. It gets very complicated, and performance is usually priority #1.
Re:Insane state of today's advertising part 3 by baybal2 on Friday September 01, 2017 @01:22AM (#15146315)
>performance is usually priority #1.

Not usually. Stalling for time in every allowed way to get more bids is something usual

Re:Insane state of today's advertising part 3 by gpm on Thursday August 31, 2017 @11:25PM (#15145888)
The proxy suggestion seems to have merit though, it would still give advertisers the ability to run auctions, track users and ad views, etc, while avoiding domain filtering.

OTOH I suspect ad blockers would adapt quickly... it's not clear it would be worth the investment to set up.

Re:Insane state of today's advertising part 3 by beagle3 on Thursday August 31, 2017 @11:35PM (#15145926)
It would generally stop advertisers from being able to verify ad impression, or to correlate users across sites. killing the most successful advertising whale (retargeting) in the process.
Re:Insane state of today's advertising part 3 by alkonaut on Friday September 01, 2017 @06:38AM (#15147365)
Why is that?

Assuming that the advertising site would just have a proxy that tunnelled everything to the ad server, would the ad server not get the exact same traffic?

Do you mean that the problem is that the site showing the ads could easily fake more client traffic to the ad server?

Re:Insane state of today's advertising part 3 by beagle3 on Friday September 01, 2017 @09:00AM (#15147982)
> site showing the ads could easily fake

Yes, that's what I mean by "unable to verify"; If the site is honest, everyone would be just as happy, but there is already so much fraud, even with (relatively) trustworthy Google and Facebook, that everyone wants some ability to verify; If all the traffic goes only through the site, that ability is lost.

> Assuming that the advertising site would just have a proxy that tunnelled everything to the ad server, would the ad server not get the exact same traffic?

Not exactly - the wide-sense-cookies[0] that allow the ad server to track users across different web sites would not be. Fingerprinting[1] would still work subject to advertisers trusting the proxy.

[0] including flash objects, etags, localstorage, etc, see https://samy.pl/evercookie/ for a 7-year-old discussion.

[1] https://panopticlick.eff.org/

Re:Insane state of today's advertising part 3 by lern_too_spel on Thursday August 31, 2017 @11:34PM (#15145924)
They wouldn't be able to track users across publishers and through to their conversion pages.
Re:Insane state of today's advertising part 3 by mirimir on Friday September 01, 2017 @02:39AM (#15146614)
So what happens when ads are being blocked? Does the real-time auction still occur?
Re:Insane state of today's advertising part 3 by Macha on Friday September 01, 2017 @05:15AM (#15147109)
No, usually the ad blockers will block the SSP's script which (depending on implementation) is either responsible for managing the auction, or calling a server which manages the auction. In theory it's possible for the adblocked to miss the SSP but block the eventual winner of the auction and at least on the demand side, we don't pay out for the lack of an impression (not sure of the terms between SSPs and publisher as to which of the two end up eating the lost opportunity, but I suspect the SSP's push it back to the publisher)
Re:Insane state of today's advertising part 3 by kirubakaran on Thursday August 31, 2017 @10:55PM (#15145772)
Offtopic: The website in your profile http://encona.com/ seems to be down.
Re:Insane state of today's advertising part 3 by TheSpiceIsLife on Thursday August 31, 2017 @11:26PM (#15145891)
Pro tip: not all domain names have an associated website. Mine neither.
Re:Insane state of today's advertising part 3 by kirubakaran on Friday September 01, 2017 @01:09AM (#15146256)
Pro pro tip, it did at one point ;-)

https://web.archive.org/web/20150925213001/encona.com/

Re:Insane state of today's advertising part 3 by rahimnathwani on Friday September 01, 2017 @01:31AM (#15146359)
Haha, yes it did. But it had little traffic and what little useful information it contained is mostly out of date.
Re:Insane state of today's advertising part 3 by chippy on Friday September 01, 2017 @05:48AM (#15147214)
Encona is also a very popular and in my opinion delicious brand of hot spicy sauces in the UK.
Re:Insane state of today's advertising part 3 by rahimnathwani on Friday September 01, 2017 @09:04AM (#15148001)
Yup. I live in China now, so bring back a few bottles of Encona's 'original' hot pepper sauce on each visit to the UK.
Re:Insane state of today's advertising part 3 by joombaga on Thursday August 31, 2017 @11:35PM (#15145929)
Yeah, but they usually have a DNS record. Which, encona.com does. text and MX, just no A or CNAME.
Re:Insane state of today's advertising part 3 by TheSpiceIsLife on Thursday August 31, 2017 @11:46PM (#15145972)
If I understand correctly, I don't think an A record is necessary if you're just using the domain for email.

I only use mine for email. I have an A record but that just results in a 'No page found' page hosted by my DNS provider. Without the A record my email would still work but browsing to k45j.com would give a 'This site can’t be reached' the same way encona.com

Re:Insane state of today's advertising part 3 by joombaga on Friday September 01, 2017 @12:17AM (#15146083)
Yep, that's correct.
Re:Insane state of today's advertising part 3 by tedunangst on Thursday August 31, 2017 @11:38PM (#15145937)
An MX record perhaps.
Re:Insane state of today's advertising part 3 by retox on Thursday August 31, 2017 @11:34PM (#15145921)
Probably a bad idea to let ad companies serve from your domain. It would give them access to cookies and local context javascript.
Re:Insane state of today's advertising part 3 by ghughes on Thursday August 31, 2017 @10:22PM (#15145653)
That's exactly what the adtech industry is starting to do. They've even got WordPress and Cloudflare plugins that can dynamically reinsert blocked ads via their proxy.
Re:Insane state of today's advertising part 3 by gradys on Thursday August 31, 2017 @10:27PM (#15145678)
Maybe not with the techniques they're using now, but if humans can tell it's an ad, then an ad blocker with say an image recognition model can too.
Re:Insane state of today's advertising part 3 by SerLava on Thursday August 31, 2017 @10:39PM (#15145719)
Easy- just make ads that humans can't tell are ads. Also helps if you make ads that the FCC can't tell are ads! As they've been doing.... sigh.
Re:Insane state of today's advertising part 3 by PeachPlum on Friday September 01, 2017 @04:00AM (#15146892)
First page impression :

I'm just going to sip from my delicious cup of Niscafe coffee, the best around, while I write this review of the Nvodua graphics card.

Next page impression

I'm just going to dab my brow with the silky smooth Kloonix napkin, the best around, while I write this review of the Nvodua graphics card.

etc.

Re:Insane state of today's advertising part 3 by loeg on Thursday August 31, 2017 @11:13PM (#15145837)
Native content can be really difficult for humans to distinguish.
Re:Insane state of today's advertising part 3 by Spivak on Thursday August 31, 2017 @11:51PM (#15145993)
Surely there will be an eventual crackdown of sponsored content that isn't marked as such.
Re:Insane state of today's advertising part 3 by iainmerrick on Friday September 01, 2017 @12:19AM (#15146089)
Crackdown by whom?

Advertisers and publishers are generally in favor of it, consumers don't care, watchdogs are toothless.

Re:Insane state of today's advertising part 3 by brainfire on Friday September 01, 2017 @12:36AM (#15146156)
In the US, the FTC. Or do you consider them toothless? It does seem like they're at least making the appearance of trying: https://www.ftc.gov/news-events/press-releases/2016/03/lord-...
Re:Insane state of today's advertising part 3 by PeachPlum on Friday September 01, 2017 @04:08AM (#15146918)
Product placement is legal in TV, why not papers published on arxiv?
Re:Insane state of today's advertising part 3 by duncan_bayne on Thursday August 31, 2017 @10:25PM (#15145670)
Just wait for Bayesian filters that block specific areas of the downloaded content.
Re:Insane state of today's advertising part 3 by firebones on Thursday August 31, 2017 @10:45PM (#15145731)
Core War, only for adtech. Let the games begin.
Re:Insane state of today's advertising part 3 by flukus on Thursday August 31, 2017 @11:05PM (#15145808)
Canvas + WebAssembly to the advertisers rescue. You didn't really think this technology was created to make life better for users did you?
Re:Insane state of today's advertising part 3 by teolandon on Friday September 01, 2017 @12:53AM (#15146203)
As long as I am able to block any element I want using my browser (and god help us if we reach a state where we can't), I won't have to look at any ad for more than 2 seconds. Any website that has too many ads to disable manually, or is in some way embedded with critical parts of the website is simply not worth my time.
Re:Insane state of today's advertising part 3 by clarry on Friday September 01, 2017 @01:34AM (#15146372)
> As long as I am able to block any element I want using my browser (and god help us if we reach a state where we can't)

Render content & ads on a single canvas?

Re:Insane state of today's advertising part 3 by dkersten on Friday September 01, 2017 @07:46AM (#15147580)
I believe that falls under

> Any website that has too many ads to disable manually, or is in some way embedded with critical parts of the website is simply not worth my time.

Re:Insane state of today's advertising part 3 by _pmf_ on Friday September 01, 2017 @02:33AM (#15146593)
> They've even got WordPress and Cloudflare plugins that can dynamically reinsert blocked ads via their proxy.

Using https with CDNs is basically a very funny large scale practical joke.

Re:Insane state of today's advertising part 3 by p49k on Thursday August 31, 2017 @11:37PM (#15145936)
Advertisers/ad networks need to serve ads from their own domains so that they can identify the visitor via 3rd-party cookies and serve the most appropriate ad.
Re:Insane state of today's advertising part 3 by notzorbo3 on Friday September 01, 2017 @01:02AM (#15146232)
> serve the most appropriate ad

Is it just me, or is this approach not very useful? I'll google for a certain product, do a little bit of research and then buy what I finally picked. Then I'm stuck with seeing ads for similar products for the forseeable future. Ads for a product I already bought and no longer have an interest in.

I think ads would actually do better if they're just targeted to the demographic that fits the page I'm currently looking at without being personalized.

Re:Insane state of today's advertising part 3 by geocar on Friday September 01, 2017 @01:47AM (#15146420)
> I think ads would actually do better if they're just targeted to the demographic that fits the page I'm currently looking at without being personalized.

There's a gap: Getting search/retargeting interest information is almost instant, but finding out you've purchased is hard and takes time.

However it's effective enough: Retargeting boosts most verticals by as much as 3-5x, and where that one click pays $1 the ads cost about $3 per thousand to display them.

Re:Insane state of today's advertising part 3 by iamaelephant on Friday September 01, 2017 @12:50AM (#15146190)
No, they don't "need" to do that. Not any more than newspaper, magazine or television advertisers "need" to know anything about the individuals seeing the ad, beyond the target demographic of the publication. They do it because there's money in it, but if website owners could put the welfare of their customers ahead of the relentless pursuit of profit by serving manually curated, static, untargeted ads we could have a much nicer web.
Re:Insane state of today's advertising part 3 by pedro_hab on Thursday August 31, 2017 @10:28PM (#15145683)
It's the easiest way to serve an dynamic ad, it will require further configuration to get it to go through your own domain, and ad blockers block by element selectors and ad placement, so even those served through your domain will eventually get blocked. To avoid adblocker one would have to actually blend the ad with page moving it in the page to avoid getting detected, which might not be acceptable UX/UI.
Re:Insane state of today's advertising part 3 by intrasight on Friday September 01, 2017 @10:11AM (#15148436)
Please elaborate. I assumed just the opposite was the case.
Re:Insane state of today's advertising part 3 by gorhill on Friday September 01, 2017 @06:39AM (#15147368)
Sites do this. For example, see Instart Logic: https://github.com/gorhill/uBO-Extra/wiki/Sites-on-which-uBO...