News for hackers. Stuff that matters.
Re:Tell HN: The front page of Hacker News has been deindexed... by Roedou on Thursday June 27, 2013 @07:04PM (#5955263)
I found this old thread, where pg had blocked most of the Google bots, and it caused Google to think the site was down:

https://news.ycombinator.com/item?id=3277661

Could be a similar issue? I'll take a look.

Re:Tell HN: The front page of Hacker News has been deindexed... by Roedou on Thursday June 27, 2013 @07:15PM (#5955316)
pg also commented that he doesn't want traffic from Google anyway: https://news.ycombinator.com/item?id=5808990

In which case, he should add: <meta name="googlebot" content="noindex"> to the html head of every page.

(I have to say, that's a smart way of avoiding any Eternal Septembering, but it'd be a shame. I often use Google to find old HN threads that I vaguely remember from months or years ago.)

Re:Tell HN: The front page of Hacker News has been deindexed... by dnautics on Thursday June 27, 2013 @07:17PM (#5955322)
you may want to consider using hnsearch.
Re:Tell HN: The front page of Hacker News has been deindexed... by saurik on Thursday June 27, 2013 @07:42PM (#5955402)
(Google's search is often better for this purpose as it has features like synonym/typo fixing and as it indexes entire pages lets you match keywords across entire threads: hnsearch is myopic on individual posts.)
Re:Tell HN: The front page of Hacker News has been deindexed... by snogglethorpe on Thursday June 27, 2013 @10:48PM (#5955914)
Yup...

Even sites with good search functions are often still way outclassed by google search with "site:..."—and most sites don't have good search functions...