News for hackers. Stuff that matters.

A comment on Google not indexing Craigslist – SearchTempest switches to Bing.

Re:Google not indexing Craigslist – SearchTempest switches t... by jzawodn on Thursday March 14, 2013 @11:00PM (#5379014)
http://www.craigslist.org/robots.txt
[ Parent | on HN ]
Re:Google not indexing Craigslist – SearchTempest switches t... by Groxx on Friday March 15, 2013 @01:17AM (#5379317)
Doesn't seem to include the /sys posts that are the main topic of discussion. Unless it has changed?
[ Parent | on HN ]