News for hackers. Stuff that matters.
Re:Scraping the web with Node.io by rasur on Friday April 15, 2011 @05:52PM (#2452353)
Does it cope with dynamically generated (ie by JS) pages? That'd be a big win for me..
Re:Scraping the web with Node.io by chrisohara on Friday April 15, 2011 @06:37PM (#2452491)
Yes, it's something I'm experimenting with at the moment. You can select JSDOM (https://github.com/tmpvar/jsdom) - which has the ability to handle JS - as an alternative parser. Set the following two options:

    jsdom: 1
    external_resources: 1
Watch this space: https://github.com/chriso/node.io/blob/master/lib/node.io/do...
Re:Scraping the web with Node.io by rasur on Friday April 15, 2011 @07:05PM (#2452550)
thanks for the info.