News for hackers. Stuff that matters.
Re:Pro scraping with Node.JS by DTrejo on Sunday January 23, 2011 @03:45AM (#2132076)
Hey Chris, I was just trying to share a few things I'd learned. I know I haven't done as much scraping as others (like yourself and richcollins). Glad I've helped get some discussion going :)
Re:Pro scraping with Node.JS by chrisohara on Sunday January 23, 2011 @04:26AM (#2132113)
Hey David, it wasn't a stab at your blog - your post was great - anything that builds some more interest in node.js is positive :) I just hate reading about people having trouble with JSDom and putting it down to the node platform. JSDom is an excellent parser, it just fails miserably when you feed it malformed HTML, and as we know, a majority of the internet falls in to this category. I needed a framework that could scrape anything on the web so I built it myself
Re:Pro scraping with Node.JS by tmpvar on Sunday January 23, 2011 @05:33PM (#2133522)
just to be clear, jsdom is not a parser. By default it uses node-htmlparser which is not very lenient.

Have you tried using Aria's html5 parser? I hear it works better with malformed markup.