News for hackers. Stuff that matters.
Re:LinkedIn's Data Infrastructure by rjurney on Thursday August 05, 2010 @03:26PM (#1579046)
Pagerank is a like a markov chain - you iterate the same dataset over and over until you're happy with the result. If 20 is good enough, its good enough. Good explanation here: http://www.iterativemapreduce.org/samples.html#Pagerank

Whereas if you include signals from multiple sources, the joins are each one MR job, never mind the calculations.

There are no comments on this comment yet.