Re:I Don’t Need No Stinking API: Web Scraping For Fun and Pr...
by bdcravens on Sunday December 09, 2012 @02:38AM
(#4894169)
Playing with it now, and while it seems to hit my download need, I can't seem to get it to play nice with sites that are JavaScript dependent. Am I missing something, or is there a way to plugin an underlying WebKit engine?
[ Parent
| on HN ]
Re:I Don’t Need No Stinking API: Web Scraping For Fun and Pr...
by bryogenic on Sunday December 09, 2012 @08:33AM
(#4894692)
PhantomJS is capable of downloading binary content from js dependent sites but it is a journey to get it working as it is not an out-of-the-box feature. Instead use CasperJS to drive Phantom and get a ton of snazzy features including simple binary downloads. Happy scraping!