News for hackers. Stuff that matters.

A comment on Show HN: Crawlie – Free open-source SEO audit tool for humans and agents.

Re:Show HN: Crawlie – Free open-source SEO audit tool for hu... by SeriousM on Friday June 19, 2026 @03:01AM (#48595649)
That's nice! I like that it also checks for the llms.txt. It seems to me that no SEO agency is aware of this simple but powerful file.
[ Parent | on HN ]
Re:Show HN: Crawlie – Free open-source SEO audit tool for hu... by seandotexe on Friday June 19, 2026 @04:28AM (#48596236)
Thank you!! Lots more to come

Honestly, the industry is half-torn on whether llms.txt does anything... we're in such a new world. But the same ol' SEO tricks still apply for AI engines for sure.

[ Parent | on HN ]