News for hackers. Stuff that matters.

A comment on Turn entire websites into LLM-ready data.

Re:Turn entire websites into LLM-ready data by pryelluw on Saturday April 13, 2024 @07:51PM (#40027315)
Does this respect any anti AI related scraping rules set forth by website owners?
[ Parent | on HN ]
Re:Turn entire websites into LLM-ready data by duskwuff on Saturday April 13, 2024 @08:02PM (#40027403)
It doesn't even respect general robots.txt exclusions, so... I doubt it.
[ Parent | on HN ]