News for hackers. Stuff that matters.
Re:Upton: A Web Scraping Framework by ricardobeat on Monday July 22, 2013 @06:13PM (#6086808)
Looks like a very nice integrated solution for data scientists and researchers. It's interesting to see the different shapes tools like this take, depending on their target users. I've been happy with node.js + cheerio[1] and it's simplistic jquery-like API:

    request 'http://website.com/list_of_stories.html', (err, body) ->
        $ = cheerio.load(body)
        callback $('#comments li a.commenter-name').map(cheerio::text)
Plus if you need to handle javascript/ajax, just replace that with jsdom/chimera with minor changes.

[1] http://npmjs.org/package/cheerio

Re:Upton: A Web Scraping Framework by chuckd1356 on Wednesday July 24, 2013 @07:15AM (#6095461)
I found using cheerio with request and phantom.js makes anything possible.

https://github.com/mikeal/request https://github.com/sgentle/phantomjs-node

Re:Upton: A Web Scraping Framework by olalonde on Monday July 22, 2013 @07:58PM (#6087317)