Re:Serverless PhantomJS with IronWorker
by heretohelp on Wednesday July 11, 2012 @03:31PM
(#4230990)
casperjs is pretty unreliable, I wouldn't bother. Even for relatively trivial frontend testing we were using it for, it would crash ~50% of the time on Linux and Mac.
Re:Serverless PhantomJS with IronWorker
by baudehlo on Wednesday July 11, 2012 @06:03PM
(#4231714)
PhantomJS 1.6 is massively unstable. Downgrade to 1.5. I'm really surprised this hasn't been fixed yet - there are bugs in their tracker related to it.
Re:Serverless PhantomJS with IronWorker
by zhodge on Wednesday July 11, 2012 @04:10PM
(#4231190)
Really? I actually found it to be quite stable for a scrape project I had; it was rather trivial too though.
My only gripe is with the cryptic error messages I was receiving when executing JavaScript in a casper browser. But that could have just been my ignorance and unfamiliarity.
Let me know if you have any questions or issues. I'll try and do something more exciting later like grab 100 sites, create pdfs, and store them in S3 all in parallel.
ERROR -- IronWorkerNG: Can't find src with path='node_modules'
and then follow the directions from /binary/phantom-nodejs
I just included the whole CasperJS library with the worker package and followed the getting started example from the Casper site.
Additionally you could install it using the build() command in the .worker file very similar to the way PhantomJS is installed.
My only gripe is with the cryptic error messages I was receiving when executing JavaScript in a casper browser. But that could have just been my ignorance and unfamiliarity.
https://github.com/iron-io/iron_worker_examples/tree/master/...
then follow the blog post.
Let me know if you have any questions or issues. I'll try and do something more exciting later like grab 100 sites, create pdfs, and store them in S3 all in parallel.