News for hackers. Stuff that matters.
Re:Pro scraping with Node.JS by tszming on Sunday January 23, 2011 @03:05AM (#2132025)
Currently I am using Selenium RC + jQuery for scraping. It is slow but it is the most reliable (due to using a real browser) solution you can get.

Anyway, will try your method soon.

Re:Pro scraping with Node.JS by tworats on Sunday January 23, 2011 @01:48PM (#2133015)
Could you provide mode details on this, either in the comments here or in a blog post? I almost went with Selenium but ended up with a custom system to drive Firefox, would love to learn more about what the Selenium based solution looks like.
Re:Pro scraping with Node.JS by tszming on Monday January 24, 2011 @01:14PM (#2136015)
Just a few lines of code, no magic needed.

Example: https://github.com/tszming/Selenium-Google-Scrapper