News for hackers. Stuff that matters.
Re:Show HN: Scrape the web by injecting JavaScript into web ... by bitplanets on Tuesday December 23, 2014 @07:28AM (#8787861)
This is cheerio with node.js and extra bells. Example: http://projs.hackhat.com/the-making-of-the-hackernews-crawle...
Re:Show HN: Scrape the web by injecting JavaScript into web ... by dale-cooper on Tuesday December 23, 2014 @08:48AM (#8788064)
Sounds more like phantomjs/casperjs.
Re:Show HN: Scrape the web by injecting JavaScript into web ... by TheEspion on Tuesday December 23, 2014 @09:52AM (#8788293)
Espion is similar to PhantomJS in that they're both headless browsers that you can inject JavaScript into.

Espion comes with a lot more. First there is the infrastructure: processing power, storage, connectivity and IP addresses that you don't have to provision, set up or manage. Second, Espion includes the features that surround extracting data from a site such as job scheduling, data quality monitoring, online debugging and problem resolution and data delivery.

PhantomJS is perfectly viable, but if you need the features I highlighted and use it, you'll have to build a lot yourself to get the job done.

Re:Show HN: Scrape the web by injecting JavaScript into web ... by gildas on Tuesday December 23, 2014 @10:53AM (#8788603)
So, is the Espion headless browser based on an existing one? If this is the case, which one?
Re:Show HN: Scrape the web by injecting JavaScript into web ... by asdf123456 on Tuesday December 23, 2014 @11:16AM (#8788700)
it's just PhantomJS wrapped up behind a cloud