Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by eeeeeeeeeeeee on Friday June 17, 2016 @03:27PM
(#11924990)
I agree, but I usually get around it by going the URL from Google and the referral from Google will work. I really have no idea why this doesn't get them de-listed from Google.
[ Parent
| on HN ]
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by chipperyman573 on Friday June 17, 2016 @04:34PM
(#11925372)
Because they aren't breaking any rules.
You're allowed to show different content based on referrers, just not if the user-agent is googlebot.
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by stingraycharles on Friday June 17, 2016 @06:03PM
(#11925829)
So which content are you supposed to show to googlebot?
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by chipperyman573 on Friday June 17, 2016 @06:42PM
(#11925994)
The same content that you would show to other users.
Googlebot's referrer is google.com, so it is able to bypass the paywall, just like anyone else clicking off google.com
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by stingraycharles on Saturday June 18, 2016 @04:19AM
(#11927565)
Right. So is the correct "fix" for this situation perhaps for googlebot to stop sending this referer?
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by chipperyman573 on Saturday June 18, 2016 @12:21PM
(#11929224)
Google wants to see what the site will look like to someone who clicks to it from google, because that's what their users will be doing.