News for hackers. Stuff that matters.
Re:Why functional programming matters (aka MapReduce for hum... by SeoxyS on Saturday March 10, 2012 @05:30PM (#3688897)
I hardly see this as an example of what's great about map/reduce or functional programming… It doesn't illustrate either the core concept of map/reduce, or that of functional programming.

I think this is a better basic example (in clojure) of what makes functional programming and map/reduce powerful (skipping Hadoop, while we're at it):

    (defn wc-map [str]
      (let [words (split str #"\s+")]
        (map
          (fn [p] [(first p) (map (fn [_] 1) (second p))]) 
          (group-by (fn [x] x) words))))
    
    (defn wc-reduce [h]
      (map (fn [p] [(first p) (reduce + (second p))]) h))
Simple word count function, completely functional, and using the map/reduce concept.

This function allows you to infinitely parallelize word counts: you could simply run `wc-map` on a file and `wc-reduce`, maybe even on multiple servers, merge (merge-with concat) the results, and run it through `wc-reduce` again, ad infinitum.

Re:Why functional programming matters (aka MapReduce for hum... by adeelk on Sunday March 11, 2012 @03:29AM (#3689849)
You can use `identity` instead of (fn [x] x).