Re:Crawling the web at $2 per million pages
by jhammerb on Wednesday September 23, 2009 @10:42PM
(#840515)
Stuff the results of the crawl into Hadoop, write some MapReduce jobs to process the data, and then serve the structured data back up with HBase?
[ Parent
| on HN ]
There are no comments on this comment yet.