Web Scraping for Me, but Not for Thee

Re:Web Scraping for Me, but Not for Thee by waydegg on Friday August 25, 2023 @04:34PM (#37266689)

It's interesting seeing the reactions from other websites/orgs after OpenAI publicly announced GPTBot. Tons of people blocking GPTBot outright (made a small page that track this: https://wayde.gg/websites-blocking-openai)

[ Parent | on HN ]

Re:Web Scraping for Me, but Not for Thee by version_five on Friday August 25, 2023 @04:37PM (#37266724)

I wonder if blocking gptbot is a good signal that a website has non LLM generated content on it, and is therefore good training data...

[ Parent | on HN ]

Re:Web Scraping for Me, but Not for Thee by Springtime on Saturday August 26, 2023 @03:13AM (#37270525)

An illustrator specifically wrote[1] that this is why they won't be tagging their social media posts with #HumanMade, #NoAI and similar, as it's a signal there's unadulterated training data.

[1] https://www.davidrevoy.com/article977/artificial-inteligence...

[ Parent | on HN ]

Re:Web Scraping for Me, but Not for Thee by dontupvoteme on Friday August 25, 2023 @06:21PM (#37267740)

Is there any legal issue with a spider trap designed to poison LLMs?

[ Parent | on HN ]