News for hackers. Stuff that matters.

Phiality

P.S The website of the project is https://librecrawl.com/

Show HN: LibreCrawl – Open-source SEO crawler with unlimited URLs (Free SF alt)

https://github.com/PhialsBasement/LibreCrawl

Screaming Frog costs $259/year per user, has a 500 URL free limit, and crashes on large sites due to memory issues. For agencies with 5+ team members, that's $1,300+ annually.LibreCrawl is completely free, handles 1M+ URLs smoothly using virtual scrolling and memory profiling, and includes features even paid tools don't have (multi-session support, custom CSS injection, real-time memory...

( Read More... | 1 comment | 2 points | on HN )
This is so cool