News for hackers. Stuff that matters.

A comment on Ask HN: Any way to ban GPT-4 and others from harvesting my content and data?.

Re:Ask HN: Any way to ban GPT-4 and others from harvesting m... by PaulsWallet on Saturday August 13, 2022 @07:57PM (#32454924)
I believe most people respect robots.txt on your site. If they don't I don't think there is anything you can do about it but in general most companies do. At least most companies I've had personal experience with.
[ Parent | on HN ]
Re:Ask HN: Any way to ban GPT-4 and others from harvesting m... by falcolas on Saturday August 13, 2022 @08:40PM (#32455175)
What's the appropriate user agents to disallow if you want to let search engines in, but not ML training crawlers?
[ Parent | on HN ]
Re:Ask HN: Any way to ban GPT-4 and others from harvesting m... by sharmi on Sunday August 14, 2022 @01:40AM (#32456707)
You will need to disallow all and enable specific search engine crawler ids

Something akin to https://stackoverflow.com/questions/59092667/allow-only-goog...

[ Parent | on HN ]