News for hackers. Stuff that matters.
Re:Google’s robots.txt parser is now open source by penagwin on Monday July 01, 2019 @03:26PM (#20328842)
I don't mean to be rude, but the rest of my comment explains why. If there's something about it that's confusing I'd love to clarify it.
Re:Google’s robots.txt parser is now open source by igouy on Monday July 01, 2019 @07:46PM (#20330831)
> the rest of my comment explains why

The rest of the comment makes some claims about performance, but does not show why we should believe those claims.