News for hackers. Stuff that matters.

seandotexe

Launched a new spin-off product from our crawler, using the index we store to offer way cheaper and fast site search (dogfooding on crawlie.co)

Literally just add your URL and you get a search widget. Great for doc sites etc.

Currently totally free while we're building it out, reading all feedback (smash the feedback button in app sidebar) :)

We had a bunch of success from posting on here from you lovely people for Crawlie's open source technical SEO audit tool that runs locally in Rust. Thank you for the 88+ stars!

We now offer a hosted edition that allows for large-scale crawls & automatic monitoring (with much more to come), for those who don't want to melt their laptop with local crawls :)

Appreciate it Dave! Excited for you to try it out
Thank you for catching! The docs were a bit too eager on the package simplifying I worked on (oops!).. "npm i -g crawlie" is now correct

we're shipping fast, will break less things now though I promise ;)

Thank you!! Lots more to come

Honestly, the industry is half-torn on whether llms.txt does anything... we're in such a new world. But the same ol' SEO tricks still apply for AI engines for sure.

Show HN: Crawlie – Free open-source SEO audit tool for humans and agents

https://github.com/spronta/crawlie

With AI, it's faster than ever to ship a marketing site... but most of what gets generated is slop that was never built to be found. Plus the tools meant to catch that fall short: most SEO auditors cost money, don't play nicely with your agents, or tell you what's wrong without telling you how to actually rank for SEO and GEO (Generative Engine Optimization: being cited by AI search like...

( Read More... | 6 comments | 2 points | on HN )
I wanted to see what's possible with having fully autonomous 1:1 personalised newsletters thanks to AI, so cooked up this lil' research project. You sign up and get your own newsletter on your competitors every Monday and how that applies to your biz. that's the whole thing. Very much an MVP but thoughts & ideas would be amazing. Ty!