News for hackers. Stuff that matters.
Re:Free 5 Billion Page Web Index Now Available from Common C... by ChuckMcM on Tuesday November 08, 2011 @01:39AM (#3209761)
I wonder if crooks will try to exploit this crawl. As a person who has an index of the web like this it has been interesting to see what they look for. SSN's and credit card numbers are common, as are sites running older versions of PHP software or exploitable shopping carts.
Re:Free 5 Billion Page Web Index Now Available from Common C... by yaix on Tuesday November 08, 2011 @02:34AM (#3209861)
It makes it very easy for people to steal vast amounts of your content and republish it on their own sites, with ads all around it.

Many content sites have protections in place to recognize bots by their behavior or use "honeypots" to tell bots apart from human visitors and thus avoid large scale content theft.

Re:Free 5 Billion Page Web Index Now Available from Common C... by noahc on Tuesday November 08, 2011 @09:07AM (#3210735)
Presumably those protections would prevent this bot from collecting data as well?