Re:Tell HN: The front page of Hacker News has been deindexed...
by Roedou on Thursday June 27, 2013 @07:15PM
(#5955316)
pg also commented that he doesn't want traffic from Google anyway:
https://news.ycombinator.com/item?id=5808990
In which case, he should add: <meta name="googlebot" content="noindex"> to the html head of every page.
(I have to say, that's a smart way of avoiding any Eternal Septembering, but it'd be a shame. I often use Google to find old HN threads that I vaguely remember from months or years ago.)
Re:Tell HN: The front page of Hacker News has been deindexed...
by dnautics on Thursday June 27, 2013 @07:17PM
(#5955322)
you may want to consider using hnsearch.
Re:Tell HN: The front page of Hacker News has been deindexed...
by saurik on Thursday June 27, 2013 @07:42PM
(#5955402)
(Google's search is often better for this purpose as it has features like synonym/typo fixing and as it indexes entire pages lets you match keywords across entire threads: hnsearch is myopic on individual posts.)
Re:Tell HN: The front page of Hacker News has been deindexed...
by snogglethorpe on Thursday June 27, 2013 @10:48PM
(#5955914)
Yup...
Even sites with good search functions are often still way outclassed by google search with "site:..."—and most sites don't have good search functions...
https://news.ycombinator.com/item?id=3277661
Could be a similar issue? I'll take a look.