News for hackers. Stuff that matters.

A comment on Turn any website into a live, structured data feed. Parent comment

Re:Turn any website into a live, structured data feed by chadwebscraper on Wednesday February 04, 2026 @07:51PM (#46894164)
Shoot me your site and I can blacklist it
[ Parent | on HN ]
Re:Turn any website into a live, structured data feed by xnx on Thursday February 05, 2026 @01:55PM (#46903403)
That's what robots.txt is for.
[ Parent | on HN ]