News for hackers. Stuff that matters.
Re:Google’s robots.txt parser is now open source by goddtriffin on Monday July 01, 2019 @01:40PM (#20327773)
Looking forward to the robots.txt linters created as wrappers around this (especially for VSCode).

There are no comments on this comment yet.