News for hackers. Stuff that matters.
Re:MapReduce for the Masses: Zero to Hadoop in 5 minutes wit... by Radim on Friday December 16, 2011 @06:43PM (#3362826)
that's for the crawl sample, not the entire 4TB index, right?

how much data was that?

Re:MapReduce for the Masses: Zero to Hadoop in 5 minutes wit... by ssalevan on Friday December 16, 2011 @07:26PM (#3362941)
That was just for the crawl sample, yes, and was approximately 100M of data, though you can specify as much as you'd prefer.

The cool thing about running this job inside Elastic MapReduce right now is the ability to get at S3 data for free, and for cost of access outside of it, both pretty reasonable sums. Right now, you can analyze the entire dataset for around $150, and if you build a good enough algorithm you'll be able to get a lot of good information back.

We're working to index this information so you can process it even more inexpensively, so stay tuned for more updates!

Re:MapReduce for the Masses: Zero to Hadoop in 5 minutes wit... by mat_kelcey on Saturday December 17, 2011 @02:50AM (#3363753)
How is the $150 broken down?