Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by stingraycharles on Saturday June 18, 2016 @04:19AM
(#11927565)
Right. So is the correct "fix" for this situation perhaps for googlebot to stop sending this referer?
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by chipperyman573 on Saturday June 18, 2016 @12:21PM
(#11929224)
Google wants to see what the site will look like to someone who clicks to it from google, because that's what their users will be doing.
Googlebot's referrer is google.com, so it is able to bypass the paywall, just like anyone else clicking off google.com