News for hackers. Stuff that matters.

A comment on Show HN: robots.txt as a service, check web crawl rules through an API.

Re:Show HN: robots.txt as a service, check web crawl rules t... by fooock on Sunday July 28, 2019 @12:24PM (#20548307)
I created this project to use in my projects. It is open source. You can use it if you are implementing SEO tools or a web crawler. Note that this is a first alpha release.

Give me some feedback!

[ Parent | on HN ]

There are no comments on this comment yet.