Re:Scraping Web Pages With jQuery, Node.js and Jsdom
by baudehlo on Thursday March 08, 2012 @12:41PM
(#3680707)
At the low end of the scale I agree. But once you start scaling it's very difficult to run more than around 40 concurrent sessions with a browser-based scraper.
With a pure Nodejs scraper we can run over 1000 parallel sessions per CPU.
With a pure Nodejs scraper we can run over 1000 parallel sessions per CPU.