News for hackers. Stuff that matters.
Re:Panic at the Job Market by tonetegeatinst on Wednesday July 17, 2024 @01:29PM (#40988199)
Yeah this does work as long as the scraper respects robot.text

But dosnt openai and other companies use third party datasets? Like sure they do plenty of scraping but I'd bet for some stuff its cheaper to buy the dataset and then cleanup the data.

There are no comments on this comment yet.