News for hackers. Stuff that matters.
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard by eeeeeeeeeeeee on Friday June 17, 2016 @03:27PM (#11924990)
I agree, but I usually get around it by going the URL from Google and the referral from Google will work. I really have no idea why this doesn't get them de-listed from Google.
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard by chipperyman573 on Friday June 17, 2016 @04:34PM (#11925372)
Because they aren't breaking any rules.

You're allowed to show different content based on referrers, just not if the user-agent is googlebot.

Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard by stingraycharles on Friday June 17, 2016 @06:03PM (#11925829)
So which content are you supposed to show to googlebot?
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard by chipperyman573 on Friday June 17, 2016 @06:42PM (#11925994)
The same content that you would show to other users.

Googlebot's referrer is google.com, so it is able to bypass the paywall, just like anyone else clicking off google.com

Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard by stingraycharles on Saturday June 18, 2016 @04:19AM (#11927565)
Right. So is the correct "fix" for this situation perhaps for googlebot to stop sending this referer?
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard by chipperyman573 on Saturday June 18, 2016 @12:21PM (#11929224)
Google wants to see what the site will look like to someone who clicks to it from google, because that's what their users will be doing.