News for hackers. Stuff that matters.
Re:Insane state of today's advertising part 3 by doctorless on Thursday August 31, 2017 @10:03PM (#15145577)
I'm actually rather surprised that companies like Google aren't offering solutions to integrate ads into the delivery of the page content itself rather than JavaScript at this point, as it's pretty easy to block the specific domains serving ads. It seems relatively straightforward; the ads would be pre-rendered on the server providing the response and could send the same info a script would for the most part, especially if there was an auxiliary script you could load from your own domain. Not that I'm endorsing the idea, it's just that it seems like an obvious solution to the usage of ad blockers.
Re:Insane state of today's advertising part 3 by allanbreyes on Thursday August 31, 2017 @10:08PM (#15145602)
I never quite understood why domain-blocking works so well for ad-blockers. I'm surprised why sites don't just use a reverse proxy or something to serve from those ad domains. What am I missing?
Re:Insane state of today's advertising part 3 by rahimnathwani on Thursday August 31, 2017 @10:26PM (#15145673)
If the ads were static (e.g. advertiser A bought a specific place on one of publisher B's pages, for a month), and advertiser A didn't want independent verification that the ads were seen, then your proposal could be simply implemented.

"What am I missing?"

Many ads are served after real-time auction: whilst your browser is loading and rendering the page, an auction is going between advertisers for the ad spot(s) on the page. The auction happens quickly, but it adds latency. Adding a reverse proxy would add further latency, and would remove the ability for ad networks to properly target ads (e.g. using cookies) and account for impressions.

Re:Insane state of today's advertising part 3 by belorn on Friday September 01, 2017 @03:09AM (#15146719)
Which reveals a problematic truth. The tracking is worth more than getting rid of ad blocking.
Re:Insane state of today's advertising part 3 by rahimnathwani on Friday September 01, 2017 @01:05PM (#15150321)
Or some amount of well-targeted advertising is worth more than a larger amount of poorly-targeted advertising.
Re:Insane state of today's advertising part 3 by kakarot on Thursday August 31, 2017 @10:45PM (#15145732)
Would you mind expanding a bit on this real-time auction thing, like how common it is and what the process looks like, or could you point me in the direction of the sources you used to make that claim?

Thanks!

Re:Insane state of today's advertising part 3 by ChuckMcM on Friday September 01, 2017 @12:12AM (#15146064)
There used to be a great article on Searchengineland about it but I can't find it now. And it was originally patented by GoTo[1] and Google was sued by Overture[2] with mixed results[3]. It did give Yahoo! which owned Overture at the time some Google stock (2.7M shares).[4] (Which, interestingly enough, if they had held would be worth more than $2B today)

[1] https://www.google.com/patents/US6269361

[2] https://www.cnet.com/news/overture-sues-google-over-search-p...

[3] http://www.waltmire.com/2014/06/02/inventor-of-pay-per-click...

[4] http://www.nytimes.com/2004/08/10/business/technology-google...

Re:Insane state of today's advertising part 3 by umeshunni on Friday September 01, 2017 @12:33AM (#15146137)
The ad auctions that happen on Google (and Yahoo etc) are a simpler version of what happens on the web since there's only one publisher (i.e Google) and a single 'ad network' (i.e. AdWords).

On the web, there are multiple publishers, served by multiple ad networks and multiple exchanges (and it's turtles all the way down)

Nowadays, bidding on the web happens through the OpenRTB protocol. See https://www.iab.com/guidelines/real-time-bidding-rtb-project... http://sharethrough.com/guides/programmatic-native/

Re:Insane state of today's advertising part 3 by ChuckMcM on Friday September 01, 2017 @01:59AM (#15146463)
I am constrained by the non-disclosure I signed when I left Google from disclosing how I know this, but I know that the auctions on Google are "not a simpler version" :-).

That said, I think IAB's efforts to make auction priced advertising available to people who don't use Google's ad network is commendable.

Re:Insane state of today's advertising part 3 by beagle3 on Friday September 01, 2017 @09:04AM (#15148000)
AppNexus[0] used to provide RTB to many networks in 2011, including Google and Facebook. Isn't that still the case?

[0] https://en.wikipedia.org/wiki/AppNexus

Re:Insane state of today's advertising part 3 by munchbunny on Thursday August 31, 2017 @10:51PM (#15145749)
If you search for the terms "real time bidding" and "ad exchange", you will find a lot of literature on how it works. The explanation and the technical underpinnings are a bit involved, which is why I'm not just outright explaining here, but you will find explanations pretty readily.
Re:Insane state of today's advertising part 3 by mangoceylon on Thursday August 31, 2017 @11:44PM (#15145963)
If you poke around AppNexus, you will find what you are looking for. The process is basically: a visitor comes to the site, each connected ad network/buyer has 100ms to provide a bid, the top bidder wins.
Re:Insane state of today's advertising part 3 by alkonaut on Friday September 01, 2017 @02:41AM (#15146619)
What happens with ad blocking visitors? They never become a visitor to bid for?

I'd actually like for my ad blocker to download all ads and pretend to download the ad, and give the impression of an impression. That way someone would have made a bid for that impression.

Otherwise what will happen is that as ad blocking use becomes more and more widespread, the ad viewers become fewer but more profitable (Ironically perhaps more profitable on average than the original set of viewers, because adblock users weren't likely to click in the first place).

If ad blocking is to be a way of killing online advertising in its current form, and not just improving the browser experience (and this is what I think should be the goal) then it needs to cheat the ad networks, they can't just pretend the request never happened.

Re:Insane state of today's advertising part 3 by therealidiot on Friday September 01, 2017 @02:59AM (#15146686)
> I'd actually like for my ad blocker to download all ads and pretend to download the ad, and give the impression of an impression. That way someone would have made a bid for that impression.

https://adnauseam.io/

Re:Insane state of today's advertising part 3 by alkonaut on Friday September 01, 2017 @03:08AM (#15146716)
Yeah I don't really think the idea of cheating any further (i.e. fake-clicking the ad) is necessary. I just want to appear like a regular ad-viewing browser that doesn't click ads.
Re:Insane state of today's advertising part 3 by chinathrow on Friday September 01, 2017 @02:45AM (#15146640)
So like your IP, browser version, plugins installed etc etc get leaked to 100s of connected buyers? How is that even remotely legal in certain EU countries?
Re:Insane state of today's advertising part 3 by goodnews3879 on Friday September 01, 2017 @01:00AM (#15146227)
It's called Real Time Bidding. It gets very complicated, and performance is usually priority #1.
Re:Insane state of today's advertising part 3 by baybal2 on Friday September 01, 2017 @01:22AM (#15146315)
>performance is usually priority #1.

Not usually. Stalling for time in every allowed way to get more bids is something usual

Re:Insane state of today's advertising part 3 by gpm on Thursday August 31, 2017 @11:25PM (#15145888)
The proxy suggestion seems to have merit though, it would still give advertisers the ability to run auctions, track users and ad views, etc, while avoiding domain filtering.

OTOH I suspect ad blockers would adapt quickly... it's not clear it would be worth the investment to set up.

Re:Insane state of today's advertising part 3 by beagle3 on Thursday August 31, 2017 @11:35PM (#15145926)
It would generally stop advertisers from being able to verify ad impression, or to correlate users across sites. killing the most successful advertising whale (retargeting) in the process.
Re:Insane state of today's advertising part 3 by alkonaut on Friday September 01, 2017 @06:38AM (#15147365)
Why is that?

Assuming that the advertising site would just have a proxy that tunnelled everything to the ad server, would the ad server not get the exact same traffic?

Do you mean that the problem is that the site showing the ads could easily fake more client traffic to the ad server?

Re:Insane state of today's advertising part 3 by beagle3 on Friday September 01, 2017 @09:00AM (#15147982)
> site showing the ads could easily fake

Yes, that's what I mean by "unable to verify"; If the site is honest, everyone would be just as happy, but there is already so much fraud, even with (relatively) trustworthy Google and Facebook, that everyone wants some ability to verify; If all the traffic goes only through the site, that ability is lost.

> Assuming that the advertising site would just have a proxy that tunnelled everything to the ad server, would the ad server not get the exact same traffic?

Not exactly - the wide-sense-cookies[0] that allow the ad server to track users across different web sites would not be. Fingerprinting[1] would still work subject to advertisers trusting the proxy.

[0] including flash objects, etags, localstorage, etc, see https://samy.pl/evercookie/ for a 7-year-old discussion.

[1] https://panopticlick.eff.org/

Re:Insane state of today's advertising part 3 by lern_too_spel on Thursday August 31, 2017 @11:34PM (#15145924)
They wouldn't be able to track users across publishers and through to their conversion pages.
Re:Insane state of today's advertising part 3 by mirimir on Friday September 01, 2017 @02:39AM (#15146614)
So what happens when ads are being blocked? Does the real-time auction still occur?
Re:Insane state of today's advertising part 3 by Macha on Friday September 01, 2017 @05:15AM (#15147109)
No, usually the ad blockers will block the SSP's script which (depending on implementation) is either responsible for managing the auction, or calling a server which manages the auction. In theory it's possible for the adblocked to miss the SSP but block the eventual winner of the auction and at least on the demand side, we don't pay out for the lack of an impression (not sure of the terms between SSPs and publisher as to which of the two end up eating the lost opportunity, but I suspect the SSP's push it back to the publisher)
Re:Insane state of today's advertising part 3 by kirubakaran on Thursday August 31, 2017 @10:55PM (#15145772)
Offtopic: The website in your profile http://encona.com/ seems to be down.
Re:Insane state of today's advertising part 3 by TheSpiceIsLife on Thursday August 31, 2017 @11:26PM (#15145891)
Pro tip: not all domain names have an associated website. Mine neither.
Re:Insane state of today's advertising part 3 by kirubakaran on Friday September 01, 2017 @01:09AM (#15146256)
Pro pro tip, it did at one point ;-)

https://web.archive.org/web/20150925213001/encona.com/

Re:Insane state of today's advertising part 3 by rahimnathwani on Friday September 01, 2017 @01:31AM (#15146359)
Haha, yes it did. But it had little traffic and what little useful information it contained is mostly out of date.
Re:Insane state of today's advertising part 3 by chippy on Friday September 01, 2017 @05:48AM (#15147214)
Encona is also a very popular and in my opinion delicious brand of hot spicy sauces in the UK.
Re:Insane state of today's advertising part 3 by rahimnathwani on Friday September 01, 2017 @09:04AM (#15148001)
Yup. I live in China now, so bring back a few bottles of Encona's 'original' hot pepper sauce on each visit to the UK.
Re:Insane state of today's advertising part 3 by joombaga on Thursday August 31, 2017 @11:35PM (#15145929)
Yeah, but they usually have a DNS record. Which, encona.com does. text and MX, just no A or CNAME.
Re:Insane state of today's advertising part 3 by TheSpiceIsLife on Thursday August 31, 2017 @11:46PM (#15145972)
If I understand correctly, I don't think an A record is necessary if you're just using the domain for email.

I only use mine for email. I have an A record but that just results in a 'No page found' page hosted by my DNS provider. Without the A record my email would still work but browsing to k45j.com would give a 'This site can’t be reached' the same way encona.com

Re:Insane state of today's advertising part 3 by joombaga on Friday September 01, 2017 @12:17AM (#15146083)
Yep, that's correct.
Re:Insane state of today's advertising part 3 by tedunangst on Thursday August 31, 2017 @11:38PM (#15145937)
An MX record perhaps.
Re:Insane state of today's advertising part 3 by retox on Thursday August 31, 2017 @11:34PM (#15145921)
Probably a bad idea to let ad companies serve from your domain. It would give them access to cookies and local context javascript.
Re:Insane state of today's advertising part 3 by ghughes on Thursday August 31, 2017 @10:22PM (#15145653)
That's exactly what the adtech industry is starting to do. They've even got WordPress and Cloudflare plugins that can dynamically reinsert blocked ads via their proxy.
Re:Insane state of today's advertising part 3 by gradys on Thursday August 31, 2017 @10:27PM (#15145678)
Maybe not with the techniques they're using now, but if humans can tell it's an ad, then an ad blocker with say an image recognition model can too.
Re:Insane state of today's advertising part 3 by SerLava on Thursday August 31, 2017 @10:39PM (#15145719)
Easy- just make ads that humans can't tell are ads. Also helps if you make ads that the FCC can't tell are ads! As they've been doing.... sigh.
Re:Insane state of today's advertising part 3 by PeachPlum on Friday September 01, 2017 @04:00AM (#15146892)
First page impression :

I'm just going to sip from my delicious cup of Niscafe coffee, the best around, while I write this review of the Nvodua graphics card.

Next page impression

I'm just going to dab my brow with the silky smooth Kloonix napkin, the best around, while I write this review of the Nvodua graphics card.

etc.

Re:Insane state of today's advertising part 3 by loeg on Thursday August 31, 2017 @11:13PM (#15145837)
Native content can be really difficult for humans to distinguish.
Re:Insane state of today's advertising part 3 by Spivak on Thursday August 31, 2017 @11:51PM (#15145993)
Surely there will be an eventual crackdown of sponsored content that isn't marked as such.
Re:Insane state of today's advertising part 3 by iainmerrick on Friday September 01, 2017 @12:19AM (#15146089)
Crackdown by whom?

Advertisers and publishers are generally in favor of it, consumers don't care, watchdogs are toothless.

Re:Insane state of today's advertising part 3 by brainfire on Friday September 01, 2017 @12:36AM (#15146156)
In the US, the FTC. Or do you consider them toothless? It does seem like they're at least making the appearance of trying: https://www.ftc.gov/news-events/press-releases/2016/03/lord-...
Re:Insane state of today's advertising part 3 by PeachPlum on Friday September 01, 2017 @04:08AM (#15146918)
Product placement is legal in TV, why not papers published on arxiv?
Re:Insane state of today's advertising part 3 by duncan_bayne on Thursday August 31, 2017 @10:25PM (#15145670)
Just wait for Bayesian filters that block specific areas of the downloaded content.
Re:Insane state of today's advertising part 3 by firebones on Thursday August 31, 2017 @10:45PM (#15145731)
Core War, only for adtech. Let the games begin.
Re:Insane state of today's advertising part 3 by flukus on Thursday August 31, 2017 @11:05PM (#15145808)
Canvas + WebAssembly to the advertisers rescue. You didn't really think this technology was created to make life better for users did you?
Re:Insane state of today's advertising part 3 by teolandon on Friday September 01, 2017 @12:53AM (#15146203)
As long as I am able to block any element I want using my browser (and god help us if we reach a state where we can't), I won't have to look at any ad for more than 2 seconds. Any website that has too many ads to disable manually, or is in some way embedded with critical parts of the website is simply not worth my time.
Re:Insane state of today's advertising part 3 by clarry on Friday September 01, 2017 @01:34AM (#15146372)
> As long as I am able to block any element I want using my browser (and god help us if we reach a state where we can't)

Render content & ads on a single canvas?

Re:Insane state of today's advertising part 3 by dkersten on Friday September 01, 2017 @07:46AM (#15147580)
I believe that falls under

> Any website that has too many ads to disable manually, or is in some way embedded with critical parts of the website is simply not worth my time.

Re:Insane state of today's advertising part 3 by _pmf_ on Friday September 01, 2017 @02:33AM (#15146593)
> They've even got WordPress and Cloudflare plugins that can dynamically reinsert blocked ads via their proxy.

Using https with CDNs is basically a very funny large scale practical joke.

Re:Insane state of today's advertising part 3 by p49k on Thursday August 31, 2017 @11:37PM (#15145936)
Advertisers/ad networks need to serve ads from their own domains so that they can identify the visitor via 3rd-party cookies and serve the most appropriate ad.
Re:Insane state of today's advertising part 3 by notzorbo3 on Friday September 01, 2017 @01:02AM (#15146232)
> serve the most appropriate ad

Is it just me, or is this approach not very useful? I'll google for a certain product, do a little bit of research and then buy what I finally picked. Then I'm stuck with seeing ads for similar products for the forseeable future. Ads for a product I already bought and no longer have an interest in.

I think ads would actually do better if they're just targeted to the demographic that fits the page I'm currently looking at without being personalized.

Re:Insane state of today's advertising part 3 by geocar on Friday September 01, 2017 @01:47AM (#15146420)
> I think ads would actually do better if they're just targeted to the demographic that fits the page I'm currently looking at without being personalized.

There's a gap: Getting search/retargeting interest information is almost instant, but finding out you've purchased is hard and takes time.

However it's effective enough: Retargeting boosts most verticals by as much as 3-5x, and where that one click pays $1 the ads cost about $3 per thousand to display them.

Re:Insane state of today's advertising part 3 by iamaelephant on Friday September 01, 2017 @12:50AM (#15146190)
No, they don't "need" to do that. Not any more than newspaper, magazine or television advertisers "need" to know anything about the individuals seeing the ad, beyond the target demographic of the publication. They do it because there's money in it, but if website owners could put the welfare of their customers ahead of the relentless pursuit of profit by serving manually curated, static, untargeted ads we could have a much nicer web.
Re:Insane state of today's advertising part 3 by pedro_hab on Thursday August 31, 2017 @10:28PM (#15145683)
It's the easiest way to serve an dynamic ad, it will require further configuration to get it to go through your own domain, and ad blockers block by element selectors and ad placement, so even those served through your domain will eventually get blocked. To avoid adblocker one would have to actually blend the ad with page moving it in the page to avoid getting detected, which might not be acceptable UX/UI.
Re:Insane state of today's advertising part 3 by intrasight on Friday September 01, 2017 @10:11AM (#15148436)
Please elaborate. I assumed just the opposite was the case.
Re:Insane state of today's advertising part 3 by gorhill on Friday September 01, 2017 @06:39AM (#15147368)
Sites do this. For example, see Instart Logic: https://github.com/gorhill/uBO-Extra/wiki/Sites-on-which-uBO...
Re:Insane state of today's advertising part 3 by hyperbovine on Thursday August 31, 2017 @10:05PM (#15145588)
You've just described internet advertising circa 1997. Then Google came along...
Re:Insane state of today's advertising part 3 by LeifCarrotson on Friday September 01, 2017 @09:22AM (#15148120)
Yes, but shortly after Google came along, ad blockers (or simply adding 127.0.0.1 analytics.google.com to your hosts file) also became popular.

Why hasn't anyone responded to that?

Re:Insane state of today's advertising part 3 by mjevans on Thursday August 31, 2017 @10:06PM (#15145592)
I suspect the only way ad companies would trust this is if the pages were served from a third party (someone not directly making money off of the ads).
Re:Insane state of today's advertising part 3 by nathancahill on Thursday August 31, 2017 @10:06PM (#15145589)
Too easy to fake impressions. And it would break with caching.
Re:Insane state of today's advertising part 3 by jimktrains2 on Thursday August 31, 2017 @10:47PM (#15145740)
I've thought of a few ways to do this, as you say there are a handful of good ways to do it. My issue has always been that (1) I'm not a good salesman (2) I wouldn't know where to get advertisers.

Would love to help build the tech if someone could deal with the business.

Re:Insane state of today's advertising part 3 by 4ad on Thursday August 31, 2017 @11:00PM (#15145791)
> I'm actually rather surprised that companies like Google aren't offering solutions to integrate ads into the delivery of the page content itself rather than JavaScript at this point

Isn't that what AMP is?

Re:Insane state of today's advertising part 3 by nimbix on Friday September 01, 2017 @06:46AM (#15147390)
AMP still requests ads separately from the page and it still loads any ad without objections. It's just that if the ad is also written in AMP and signed by a validation service, it qualifies for faster loading instead of being delayed by at least 2 seconds (or is it more?) after page load and throttled to 1 ad load per second on top of that when there are multiple ad slots.
Re:Insane state of today's advertising part 3 by wdr1 on Friday September 01, 2017 @12:28AM (#15146116)
> I'm actually rather surprised that companies like Google aren't offering solutions to integrate ads into the delivery of the page content itself rather than JavaScript at this point, as it's pretty easy to block the specific domains serving ads.

You mean native advertising?

https://en.wikipedia.org/wiki/Native_advertising

https://developers.google.com/doubleclick-publishers/docs/na...

Re:Insane state of today's advertising part 3 by hobs on Thursday August 31, 2017 @10:05PM (#15145587)
I was under the impression that while some pure domain blocking occurs, a lot of the rules engines seem to be written against page content that matches specific patterns, not specific domains, so I don't know if it would help serve more ads that much.
Re:Insane state of today's advertising part 3 by SilasX on Friday September 01, 2017 @12:01AM (#15146025)
Doesn't Accelerated Mobile Pages offer something like that? That puts all your content on the Google domain, including the ads (or some version of them, I think?).
Re:Insane state of today's advertising part 3 by nimbix on Friday September 01, 2017 @06:47AM (#15147397)
AMP ads are still served from other domains; but you have the option of writing them in AMP and having them validated & signed by a service to qualify for faster loading.
Re:Insane state of today's advertising part 3 by maxerickson on Thursday August 31, 2017 @10:09PM (#15145609)
Blockers already have content rules.
Re:Insane state of today's advertising part 3 by EGreg on Thursday August 31, 2017 @11:24PM (#15145882)
Kind of like youtube content creators now put ads in the actual video?
Re:Insane state of today's advertising part 3 by tomjakubowski on Thursday August 31, 2017 @11:43PM (#15145960)
To be clear, it's against YouTube's rules to embed advertiser-supplied content (like a video, image, audio clip, etc.) directly in a YouTube video. YouTubers are free to take money for product placements and endorsements, though, as long as Google is notified.

https://support.google.com/youtube/answer/154235?hl=en

Re:Insane state of today's advertising part 3 by mej10 on Thursday August 31, 2017 @10:06PM (#15145591)
There are plenty of ad servers that offer APIs for doing that.