Re:The uncanny valley of web scraping
by cuppster on Tuesday February 28, 2012 @01:16PM
(#3644168)
Anyone scraping in Perl? I've found pQuery very useful. (I tried it in node.js to stay cool, but async scraping is an anti-pattern) You can use jQuery selectors, etc... Just posted something related to it on by blog: scrape with pQuery, dump into Redis, reformat into CSV then into mysql...
http://cuppster.com/2012/02/28/utf-8-round-trip-for-perl-mys...