Re:Crawl a website with scrapy and store extracted results w...
by jat1 on Monday April 23, 2012 @12:30PM
(#3879621)
I have been playing with scraping for quite some time now and have my own scripts and stuff, but I found that video informing and there were a few useful snippets I had missed.
Just something else to throw in the toolbelt ...
https://github.com/kennethreitz/requests
Keep meaning to check out more of the Pycon vids
[1]: http://anemone.rubyforge.org/doc/index.html
Unfortunately, the page is literally broken and unreadable on Android ICS with Chrome :(
This is a known issue and I'm working on it! I'll try to push a "responsive" version today or tomorrow.