News for hackers. Stuff that matters.

A comment on Turn any website into a live, structured data feed.

Re:Turn any website into a live, structured data feed by golfer on Wednesday February 04, 2026 @07:36PM (#46894037)
As a site owner, how does one opt out of this, since it obviously ignores robots.txt?
[ Parent | on HN ]
Re:Turn any website into a live, structured data feed by chadwebscraper on Wednesday February 04, 2026 @07:51PM (#46894164)
Shoot me your site and I can blacklist it
[ Parent | on HN ]
Re:Turn any website into a live, structured data feed by xnx on Thursday February 05, 2026 @01:55PM (#46903403)
That's what robots.txt is for.
[ Parent | on HN ]