News for hackers. Stuff that matters.
Re:Free 5 Billion Page Web Index Now Available from Common C... by ahadrana on Tuesday November 08, 2011 @10:33AM (#3211084)
The pagerank and other metadata we compute is not part of the S3 corpus, but we do collect this information and probably will make it available in a separate S3 bucket in Hadoop SequenceFiles format. Be aware that our pagerank will probably not have a high degree of correlation to Google's pagerank number, since their pagerank calculation is going to be a lot more sophisticated than our version.

There are no comments on this comment yet.