Google’s robots.txt parser is now open source

Re:Google’s robots.txt parser is now open source by igouy on Monday July 01, 2019 @02:20PM (#20328184)

> I don't believe this is the case.

Please show why you don't believe this is the case.

[ Parent | on HN ]

Re:Google’s robots.txt parser is now open source by penagwin on Monday July 01, 2019 @03:26PM (#20328842)

I don't mean to be rude, but the rest of my comment explains why. If there's something about it that's confusing I'd love to clarify it.

[ Parent | on HN ]

Re:Google’s robots.txt parser is now open source by igouy on Monday July 01, 2019 @07:46PM (#20330831)

> the rest of my comment explains why

The rest of the comment makes some claims about performance, but does not show why we should believe those claims.

[ Parent | on HN ]