News for hackers. Stuff that matters.
Re:Crawling the web at $2 per million pages by jhammerb on Wednesday September 23, 2009 @10:42PM (#840515)
Stuff the results of the crawl into Hadoop, write some MapReduce jobs to process the data, and then serve the structured data back up with HBase?

There are no comments on this comment yet.