News for hackers. Stuff that matters.
Re:Google's robots.txt by anonymfus on Sunday February 23, 2014 @04:15AM (#7285374)
Yandex's documentation about implemented robots.txt features:

http://help.yandex.com/webmaster/controlling-robot/robots-tx...

Yandex's online tool to check specific URL on allowness in robots.txt:

http://webmaster.yandex.com/robots.xml

There are no comments on this comment yet.