News for hackers. Stuff that matters.
Re:Serverless PhantomJS with IronWorker by dentldir on Wednesday July 11, 2012 @04:02PM (#4231147)
On the iron_worker upload crawler step:

ERROR -- IronWorkerNG: Can't find src with path='node_modules'

Re:Serverless PhantomJS with IronWorker by carimura on Wednesday July 11, 2012 @04:22PM (#4231270)
Hey Dentldir, make sure you get everything from that phantom-nodejs folder.... Try a git clone https://github.com/iron-io/iron_worker_examples

and then follow the directions from /binary/phantom-nodejs

Re:Serverless PhantomJS with IronWorker by dentldir on Wednesday July 11, 2012 @05:09PM (#4231501)
Much better. I manually downloaded the files the first time and missed the directory. Thanks.
Re:Serverless PhantomJS with IronWorker by enlighten_user on Wednesday July 11, 2012 @04:21PM (#4231255)
Did you copy node_modules directory from repo?
Re:Serverless PhantomJS with IronWorker by malandrew on Wednesday July 11, 2012 @03:05PM (#4230839)
What about a CasperJs version as well?
Re:Serverless PhantomJS with IronWorker by carimura on Wednesday July 11, 2012 @05:10PM (#4231510)
Here ya go: https://github.com/iron-io/iron_worker_examples/tree/master/...

I just included the whole CasperJS library with the worker package and followed the getting started example from the Casper site.

Re:Serverless PhantomJS with IronWorker by carimura on Wednesday July 11, 2012 @04:30PM (#4231312)
Haven't worked with Casper yet but I'd be happy to build a similar example in our examples repo using Casper.

Additionally you could install it using the build() command in the .worker file very similar to the way PhantomJS is installed.

Re:Serverless PhantomJS with IronWorker by jonpaul on Wednesday July 11, 2012 @04:37PM (#4231343)
Since CasperJS is just a set of JavaScript files that run on PhantomJS, you shouldn't have any problems running it.
Re:Serverless PhantomJS with IronWorker by heretohelp on Wednesday July 11, 2012 @03:31PM (#4230990)
casperjs is pretty unreliable, I wouldn't bother. Even for relatively trivial frontend testing we were using it for, it would crash ~50% of the time on Linux and Mac.
Re:Serverless PhantomJS with IronWorker by baudehlo on Wednesday July 11, 2012 @06:03PM (#4231714)
PhantomJS 1.6 is massively unstable. Downgrade to 1.5. I'm really surprised this hasn't been fixed yet - there are bugs in their tracker related to it.
Re:Serverless PhantomJS with IronWorker by heretohelp on Thursday July 12, 2012 @01:19PM (#4235533)
That appears to have fixed it.
Re:Serverless PhantomJS with IronWorker by 0k1n on Friday July 13, 2012 @03:47AM (#4238679)
I'm happy to learn that (casperjs author here)
Re:Serverless PhantomJS with IronWorker by zhodge on Wednesday July 11, 2012 @04:10PM (#4231190)
Really? I actually found it to be quite stable for a scrape project I had; it was rather trivial too though.

My only gripe is with the cryptic error messages I was receiving when executing JavaScript in a casper browser. But that could have just been my ignorance and unfamiliarity.

Re:Serverless PhantomJS with IronWorker by jonpaul on Wednesday July 11, 2012 @04:38PM (#4231348)
That's not CasperJS that's unreliable. That's PhantomJS crashing. Which version of PhantomJS where you using?
Re:Serverless PhantomJS with IronWorker by LogicX on Wednesday July 11, 2012 @05:14PM (#4231527)
I'll echo another - how about wkhtmltopdf ?
Re:Serverless PhantomJS with IronWorker by carimura on Wednesday July 11, 2012 @05:40PM (#4231650)
Hey LogicX,

https://github.com/iron-io/iron_worker_examples/tree/master/...

then follow the blog post.

Let me know if you have any questions or issues. I'll try and do something more exciting later like grab 100 sites, create pdfs, and store them in S3 all in parallel.