Re:Free 5 Billion Page Web Index Now Available from Common C...
by ahadrana on Tuesday November 08, 2011 @10:33AM
(#3211084)
The pagerank and other metadata we compute is not part of the S3 corpus, but we do collect this information and probably will make it available in a separate S3 bucket in Hadoop SequenceFiles format. Be aware that our pagerank will probably not have a high degree of correlation to Google's pagerank number, since their pagerank calculation is going to be a lot more sophisticated than our version.
[ Parent
| on HN ]
There are no comments on this comment yet.