News for hackers. Stuff that matters.
Re:The uncanny valley of web scraping by kanzure on Tuesday February 28, 2012 @11:16AM (#3643650)
I admit to using BeautifulSoup, lxml, scrapy, nokogiri and mechanize. But these days I just stick with PhantomJS. Just load the DOM with WebKit. http://phantomjs.org/
Re:The uncanny valley of web scraping by luser001 on Tuesday February 28, 2012 @04:11PM (#3645013)
I'm even lazier. :) I used the pjscrape wrapper around phantomjs.

https://github.com/nrabinowitz/pjscrape