News for hackers. Stuff that matters.
Re:A Look Inside Our 210TB 2012 Web Corpus by benhamner on Tuesday August 13, 2013 @08:38PM (#6209292)
The massive advantages that Google has include over a decade of data on the pages that people actually visited in response to a specific query as well as having an in-memory index of the public web, parts of which are updated on the order of seconds to minutes.

I wonder if there is a viable business in maintaining an in-memory & up-to-date index of the public web & selling access to it, with a pricing model that scales according to the amount of computation you are doing on it.

Re:A Look Inside Our 210TB 2012 Web Corpus by greglindahl on Tuesday August 13, 2013 @09:00PM (#6209366)
blekko has data customers playing us for that kind of thing.