News for hackers. Stuff that matters.

A comment on How to Crawl the Web Politely with Scrapy. Parent comment

Re:How to Crawl the Web Politely with Scrapy by zeroxfe on Thursday August 25, 2016 @11:57AM (#12360062)
You can rate-limit asynchronous crawlers too.
[ Parent | on HN ]

There are no comments on this comment yet.