News for hackers. Stuff that matters.

A comment on How to Crawl the Web Politely with Scrapy. Parent comment

Re:How to Crawl the Web Politely with Scrapy by stummjr on Thursday August 25, 2016 @12:30PM (#12360347)
That's kind of what Scrapy's AUTO_THROTTLE middleware does.
[ Parent | on HN ]

There are no comments on this comment yet.