News for hackers. Stuff that matters.
Re:MapReduce for the Masses: Zero to Hadoop in 5 minutes wit... by CurtHagenlocher on Friday December 16, 2011 @04:15PM (#3362359)
It would be nice if there were an estimate for how much it costs to run the sample code.

EDIT: Apparently, I can't read. :(

Re:MapReduce for the Masses: Zero to Hadoop in 5 minutes wit... by ssalevan on Friday December 16, 2011 @04:25PM (#3362399)
Hey Curt, Most of my own runs, using the 2 small VM default, resulted in 3 normalized hours of usage, which equated to around 25 cents per run.
Re:MapReduce for the Masses: Zero to Hadoop in 5 minutes wit... by Radim on Friday December 16, 2011 @06:43PM (#3362826)
that's for the crawl sample, not the entire 4TB index, right?

how much data was that?

Re:MapReduce for the Masses: Zero to Hadoop in 5 minutes wit... by ssalevan on Friday December 16, 2011 @07:26PM (#3362941)
That was just for the crawl sample, yes, and was approximately 100M of data, though you can specify as much as you'd prefer.

The cool thing about running this job inside Elastic MapReduce right now is the ability to get at S3 data for free, and for cost of access outside of it, both pretty reasonable sums. Right now, you can analyze the entire dataset for around $150, and if you build a good enough algorithm you'll be able to get a lot of good information back.

We're working to index this information so you can process it even more inexpensively, so stay tuned for more updates!

Re:MapReduce for the Masses: Zero to Hadoop in 5 minutes wit... by mat_kelcey on Saturday December 17, 2011 @02:50AM (#3363753)
How is the $150 broken down?
Re:MapReduce for the Masses: Zero to Hadoop in 5 minutes wit... by Aloisius on Friday December 16, 2011 @04:17PM (#3362372)
The blog post says it costs something like 25 cents.