Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by stingraycharles on Friday June 17, 2016 @06:03PM
(#11925829)
So which content are you supposed to show to googlebot?
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by chipperyman573 on Friday June 17, 2016 @06:42PM
(#11925994)
The same content that you would show to other users.
Googlebot's referrer is google.com, so it is able to bypass the paywall, just like anyone else clicking off google.com
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by stingraycharles on Saturday June 18, 2016 @04:19AM
(#11927565)
Right. So is the correct "fix" for this situation perhaps for googlebot to stop sending this referer?
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by chipperyman573 on Saturday June 18, 2016 @12:21PM
(#11929224)
Google wants to see what the site will look like to someone who clicks to it from google, because that's what their users will be doing.
You're allowed to show different content based on referrers, just not if the user-agent is googlebot.