Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by stingraycharles on Friday June 17, 2016 @06:03PM
(#11925829)
So which content are you supposed to show to googlebot?
[ Parent
| on HN ]
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by chipperyman573 on Friday June 17, 2016 @06:42PM
(#11925994)
The same content that you would show to other users.
Googlebot's referrer is google.com, so it is able to bypass the paywall, just like anyone else clicking off google.com
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by stingraycharles on Saturday June 18, 2016 @04:19AM
(#11927565)
Right. So is the correct "fix" for this situation perhaps for googlebot to stop sending this referer?
Re:Home Depot Files Antitrust Lawsuit Against Visa, MasterCard
by chipperyman573 on Saturday June 18, 2016 @12:21PM
(#11929224)
Google wants to see what the site will look like to someone who clicks to it from google, because that's what their users will be doing.