News for hackers. Stuff that matters.
Re:How to Crawl the Web Politely with Scrapy by greglindahl on Thursday August 25, 2016 @07:44PM (#12363334)
If you surf LinkedIn logged out, you'll see that there isn't very much information available anyway. And there's no money in people search.

Yelp was very responsive when blekko wrote them; as you can see ScoutJet has the same access as googlebot.

There are no comments on this comment yet.