News for hackers. Stuff that matters.

A comment on What one may find in robots.txt. Parent comment

Re:What one may find in robots.txt by learnstats2 on Monday May 18, 2015 @07:46AM (#9563848)
That's how internationalized domains work.

Wikipedia: https://en.wikipedia.org/wiki/Uniform_Resource_Locator#Inter...

[ Parent | on HN ]

There are no comments on this comment yet.