News for hackers. Stuff that matters.
Re:Web Scraping 101 with Python by johnnyg on Sunday March 10, 2013 @07:05PM (#5353967)
Mechanize is far and away the best and easiest way to scrape with Ruby until anything is rendered in javascript, which is explicitly not supported.

I tend to use Mechanized until I can't, then switch to Watir. Over time, I've found myself just strait up picking up Watir as it runs your browser directly and supports javascript rendering as a result.

Re:Web Scraping 101 with Python by ankimal on Sunday March 10, 2013 @08:21PM (#5354231)
How is performance with Watir? With casperjs a page takes me on an avg. 5-10 secs. to process.
Re:Web Scraping 101 with Python by johnnyg on Friday March 22, 2013 @01:17AM (#5421492)
Not great. About the same...