News for hackers. Stuff that matters.

pasteurquadrant

Re:Wouldn't it be fun to build your own Google? on Wednesday December 10, 2014 @04:55PM (#8731968)
+1

Ask HN: Google web corpus + big data analysis cluster?

Thinking about starting a developer friendly service that frequently crawls the web at massive scale + a big data analysis cluster (such as Storm) with support for a variety of languages.Obviously walled gardens like Facebook and Twitter would be off limits at the beginning, but if the service gains traction, then it's possible companies would want to be crawled.I was trying to analyze the...

( Read More... | 1 comment | 3 points | on HN )
could they be a picloud replacement?