Re:More than 1MM Facebook accounts exposed
by cleverjake on Friday November 02, 2012 @02:17AM
(#4731488)
Google ignores robots.txt if the number of inbound links is > N?
Also - any speculation as to how so many sites were lining to peoples login pages?
https://www.facebook.com/robots.txt
But, depending of the amount of inbound links, Google will index the urls anyway.
It's a common issue.