News for hackers. Stuff that matters.
Re:Scrapy Tips from the Pros by sheraz on Wednesday January 20, 2016 @10:50AM (#10938842)
Yes, if you use subclass CrawlSpider, then you will be able to set rules on your crawls [1]

[1] -http://scrapy.readthedocs.org/en/latest/topics/spiders.html?...

There are no comments on this comment yet.