News for hackers. Stuff that matters.
Re:The uncanny valley of web scraping by cuppster on Tuesday February 28, 2012 @01:16PM (#3644168)
Anyone scraping in Perl? I've found pQuery very useful. (I tried it in node.js to stay cool, but async scraping is an anti-pattern) You can use jQuery selectors, etc... Just posted something related to it on by blog: scrape with pQuery, dump into Redis, reformat into CSV then into mysql...

http://cuppster.com/2012/02/28/utf-8-round-trip-for-perl-mys...

Re:The uncanny valley of web scraping by dmn001 on Tuesday February 28, 2012 @04:15PM (#3645026)
I also use Perl for web scraping, never heard of pQuery though, I use HTML::TokeParser or HTML::TreeBuilder::XPath.