News for hackers. Stuff that matters.
Re:Google Exposed User Data, Feared Repercussions of Disclos... by waterhouse on Tuesday October 09, 2018 @12:03AM (#18173248)
Websites like WSJ manage to get listed high in the Google rankings by presenting the actual article, instead of a paywall, to the Googlebot and to requests with Google in the Referer field (as I understand it). I gather that they do the same thing to the Archive scraper. As far as I'm concerned, that's a cheap trick the website performs, and using a cheap trick to get around it seems fine to me.

There are no comments on this comment yet.