News for hackers. Stuff that matters.

A comment on Upton: A Web Scraping Framework.

Re:Upton: A Web Scraping Framework by danso on Monday July 22, 2013 @06:13PM (#6086810)
Cool library, Jeremy...another Ruby scraping framework you might want to check out and improve upon is Artsy's Spidey:

https://github.com/joeyAghion/spidey

Has a similar approach but also leaves storage (and caching) up to the end-user.

[ Parent | on HN ]
Re:Upton: A Web Scraping Framework by jeremybmerrill on Monday July 22, 2013 @10:06PM (#6087753)
Thanks, Dan. I'll check that out, especially for good ideas on how to solve things I haven't solved yet. Spidering and scraping seem to be very related, but not quite the same -- and I admittedly know nothing about spidering.
[ Parent | on HN ]