News for hackers. Stuff that matters.
Re:Infochimps cluster chef by mrflip on Thursday June 24, 2010 @02:25AM (#1457446)
DrawnToScale, Infochimps and Cloudera are having a [Hadoop on Chef on Cloud] hack day this Monday before the Hadoop Summit. Holler (@mrflip) if you're interested in the hack day, or if you'll be at Hadoop Summit and want a demo.

We've been using cluster_chef for a month+ at infochimps, and it's awesome. Want a throwaway 4-machine DB cluster to pound on? bam. done. Need to shut down two dozen m1.large instances, spin them back up as 30 c1.xlarge to process a massive CPU-intensive job, then put the whole thing away for the weekend? It spot-prices, instantiates, provisions and designates all the nodes, including EBS volume attachment and service discovery. The kind of thing you'd allot a platoon-day for is now more like an intern-morning, most of it waiting for the spot-price bid to come through.

There are no comments on this comment yet.