News for hackers. Stuff that matters.
Re:What one may find in robots.txt by tlb on Monday May 18, 2015 @12:32PM (#9565329)
It's a vector for putting in disruptive utf-8 characters, such as a huge stack of accents, or spoofing a reputable domain. It's not clear yet that the benefits to HN outweigh the risks. But if we start seeing a lot of quality content from domains that look better with punycode decoded, it'll be considered.

There are no comments on this comment yet.