News for hackers. Stuff that matters.

A comment on What one may find in robots.txt. Parent comment

Re:What one may find in robots.txt by Flimm on Monday May 18, 2015 @08:52AM (#9564106)
Interestingly, Hacker News doesn't support this standard, and the link on the front page shows the unfriendly version.
[ Parent | on HN ]
Re:What one may find in robots.txt by ozh on Monday May 18, 2015 @09:57AM (#9564420)
It's because IDN domains became a standard after tables stopped to be used in page layouts </sarcasm>
[ Parent | on HN ]