News for hackers. Stuff that matters.

A comment on Google Unfairly Curbs Web Ads and Skews Search, EU Alleges. Parent comment

Re:Google Unfairly Curbs Web Ads and Skews Search, EU Alleges by __b__ on Friday July 15, 2016 @10:07AM (#12101018)
The issue is reciprocity as to crawling. There will never be "news at 11" about that.
[ Parent | on HN ]
Re:Google Unfairly Curbs Web Ads and Skews Search, EU Alleges by tedunangst on Friday July 15, 2016 @01:21PM (#12102492)
So ban the googlebot in robots.txt and tell google you'll let them back in when they let you crawl their site.
[ Parent | on HN ]
Re:Google Unfairly Curbs Web Ads and Skews Search, EU Alleges by __b__ on Friday July 15, 2016 @09:23PM (#12104795)
Or allow Googlebot in robots.txt and then crawl Google.
[ Parent | on HN ]