News for hackers. Stuff that matters.
Re:How to Crawl the Web with Scrapy by artembugara on Monday September 13, 2021 @07:26PM (#28518224)
Second one — yes. All sources, per request.

But as a general rule, we crawl all we could/know which is a news website.

Can add any niche/industry-specific websites on request.

There are no comments on this comment yet.