News for hackers. Stuff that matters.

A comment on How to crawl a quarter billion webpages in 40 hours (2012). Parent comment

Re:How to crawl a quarter billion webpages in 40 hours (2012) by timeon on Thursday June 15, 2023 @06:46PM (#36347809)
Not sure how is it in python, but what about using something like arti-client? Would it be already blocked?
[ Parent | on HN ]

There are no comments on this comment yet.