Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Google Now Fills Out Forms & Crawls Results. Parent comment
I wonder if google always honour robots.txt
http://en.wikipedia.org/wiki/Spider_trap
I wonder if google always honour robots.txt