Upton: A Web Scraping Framework

Re:Upton: A Web Scraping Framework by nwienert on Monday July 22, 2013 @05:38PM (#6086632)

Always used anemone with great results http://anemone.rubyforge.org/

Seems like it's not being actively developed, but again, never had a problem.

Edit: realize this is focused on single page scraping with data extraction. Could use them nicely together in fact.

[ Parent | on HN ]

Re:Upton: A Web Scraping Framework by jeremybmerrill on Monday July 22, 2013 @05:52PM (#6086707)

I had never seen this before. I will check it out, at least for inspiration.

I'd say "scraping" is a little more focused on extracting data from specific pages as opposed to ALL pages as in "spidering", but the two are certainly cousins if not siblings. Anemone would probably be good at the same sorts of tasks Upton is designed for (i.e. scraping data contained on multiple pages).

[ Parent | on HN ]