News for hackers. Stuff that matters.
Re:Trouble In the House of Google by 6ren on Monday January 03, 2011 @07:52AM (#2062966)
That's assuming the scrapers will respect robots.txt. Some of them would, and that would help.

Assuming google does take into account who was first, a similar solution is for Jeff to submit his content directly to google for indexing, immediately it's published.

EDIT I'm wrong; google only accepts top-level URLs for indexing, not new content: http://www.google.com/addurl/?continue=/addurl

Re:Trouble In the House of Google by rabidsnail on Monday January 03, 2011 @09:21AM (#2063181)
You can specify specific urls by submitting a sitemap (http://www.google.com/support/webmasters/bin/answer.py?hl=en...).
Re:Trouble In the House of Google by aamar on Monday January 03, 2011 @08:07AM (#2063008)
Well, you could ban misbehaving robots by IP address. That seems like a reasonable step for bad behavior and not in conflict with Jeff's general "sharing"/"openness" values.