News for hackers. Stuff that matters.
Re:How to speed up massive data analysis by eliminating disk... by jbeda on Friday January 01, 2010 @08:42PM (#1026564)
This is basically a map reduce. You should look at hadoop as you start doing more complicated stuff.
Re:How to speed up massive data analysis by eliminating disk... by gstar on Friday January 01, 2010 @09:02PM (#1026598)
The sort mode is map-reduce style, but the overall idea was to put data sequentially on disk before you process it.
Re:How to speed up massive data analysis by eliminating disk... by brianobush on Friday January 01, 2010 @08:50PM (#1026582)
but for hadoop, you need several boxes and the admin overhead of setting it up and administrating it. if you have a large iron box, this approach works well as I have done this style many times.