Re:Ask HN: Any way to ban GPT-4 and others from harvesting m...
by falcolas on Saturday August 13, 2022 @08:40PM
(#32455175)
What's the appropriate user agents to disallow if you want to let search engines in, but not ML training crawlers?
[ Parent
| on HN ]
Re:Ask HN: Any way to ban GPT-4 and others from harvesting m...
by sharmi on Sunday August 14, 2022 @01:40AM
(#32456707)
You will need to disallow all and enable specific search engine crawler ids
Something akin to https://stackoverflow.com/questions/59092667/allow-only-goog...