News for hackers. Stuff that matters.
Re:Suddenly, Hacker News is not the first result for 'Hacker... by tibbon on Friday November 25, 2011 @01:34PM (#3277821)
Could you use some sort of sitemap or other way to provide the data to Google that isn't so damaging to site performance? Or in Google Webmaster tools turn down the rate of crawling?

Just realized that this could be a problem for lots of sites, and I'm curious as to what the best solution is, since not everyone has Matt Cutts reading their site and helping out.

Re:Suddenly, Hacker News is not the first result for 'Hacker... by Matt_Cutts on Friday November 25, 2011 @01:39PM (#3277831)
We do have a self-service tool in webmaster tools for people who prefer to be crawled slower.
Re:Suddenly, Hacker News is not the first result for 'Hacker... by arctangent on Friday November 25, 2011 @01:58PM (#3277892)
Do you support/respect the "crawl-delay" directive?

http://en.wikipedia.org/wiki/Robots_exclusion_standard#Crawl...

Re:Suddenly, Hacker News is not the first result for 'Hacker... by storborg on Friday November 25, 2011 @03:18PM (#3278101)
Nope. As mentioned above, apparently Google thinks people will "shoot themselves in the foot" with the crawl-delay directive, while they won't with Google's special interface (which requires registering and logging in).
Re:Suddenly, Hacker News is not the first result for 'Hacker... by wanorris on Friday November 25, 2011 @04:15PM (#3278245)
I can't imagine that they are just guessing abut this. I'm sure someone tried implementing it and was horrified at the actual results before they gave up on it.
Re:Suddenly, Hacker News is not the first result for 'Hacker... by einhverfr on Friday November 25, 2011 @06:58PM (#3278622)
What more can you expect from the World's Largest Adware Company?

Seriously, one thing about Google is that they seem to really like ensuring people are logged on, preferably at all times. Fortunately recent changes to Google Apps (promoting apps user accounts to full Google accounts) has made this more complex on my side and probably degraded the level of actionable info they can get out of it.

Re:Suddenly, Hacker News is not the first result for 'Hacker... by Thieum22 on Friday November 25, 2011 @02:41PM (#3277995)