Re:Scraping the web with Node.io
by rasur on Friday April 15, 2011 @05:52PM
(#2452353)
Does it cope with dynamically generated (ie by JS) pages? That'd be a big win for me..
[ Parent
| on HN ]
Re:Scraping the web with Node.io
by chrisohara on Friday April 15, 2011 @06:37PM
(#2452491)
Yes, it's something I'm experimenting with at the moment. You can select JSDOM (https://github.com/tmpvar/jsdom) - which has the ability to handle JS - as an alternative parser. Set the following two options:
jsdom: 1
external_resources: 1
Watch this space: https://github.com/chriso/node.io/blob/master/lib/node.io/do...