News for hackers. Stuff that matters.
Re:Ask HN: Any way to ban GPT-4 and others from harvesting m... by falcolas on Saturday August 13, 2022 @08:40PM (#32455175)
What's the appropriate user agents to disallow if you want to let search engines in, but not ML training crawlers?
Re:Ask HN: Any way to ban GPT-4 and others from harvesting m... by sharmi on Sunday August 14, 2022 @01:40AM (#32456707)
You will need to disallow all and enable specific search engine crawler ids

Something akin to https://stackoverflow.com/questions/59092667/allow-only-goog...