What one may find in robots.txt

Re:What one may find in robots.txt by aidenn0 on Monday May 18, 2015 @12:06PM (#9565183)

I'm on firefox, and it showed me the decoded domain.

[ Parent | on HN ]

Re:What one may find in robots.txt by dbbolton on Monday May 18, 2015 @12:27PM (#9565294)

Also on FF, 37.0.2 Linux x64 build, and I see `xn--thibaud-dya.fr` on HN but `thiébaud.fr` in the status/address bars.

[ Parent | on HN ]

Re:What one may find in robots.txt by aidenn0 on Monday May 18, 2015 @12:40PM (#9565373)

38.0.1 Linux x64

[ Parent | on HN ]