News for hackers. Stuff that matters.
Re:Show HN: I built a tool that watches webpages and exposes... by deceptionatd on Wednesday March 11, 2026 @06:23PM (#47343055)
Well-designed sitemaps and use of something like https://www.indexnow.org/ helps.

Cloudflare has Crawler Hints which works well IME: https://blog.cloudflare.com/crawler-hints-how-cloudflare-is-...

Re:Show HN: I built a tool that watches webpages and exposes... by hinkley on Wednesday March 11, 2026 @10:06PM (#47345417)
Do you know if cloudfront has anything like this?