News for hackers. Stuff that matters.

abaker87

#opensourcehn
Re:Python web scraping on Monday March 10, 2014 @05:29PM (#7375808)
Agree. Scrapy is great for this sort of thing. Takes care of little details you don't want to be worrying about.

I coupled scrapy with Stem to control Tor on the odd chance your IP gets blocked. Works great.