News for hackers. Stuff that matters.
Re:News publishers limit Internet Archive access due to AI s... by anonnon on Saturday February 14, 2026 @10:16PM (#47020711)
> The AI companies won't just scrape IA once, they're keeping come back to the same pages and scraping them over and over. Even if nothing has changed.

Why, though? Especially if the pages are new; aren't they concerned about ingesting AI-generated content?

Re:News publishers limit Internet Archive access due to AI s... by dragonwriter on Saturday February 14, 2026 @10:26PM (#47020769)
Possibly because a lot of “AI-company scraping” isn't traditional scraping (e.g., to build a dataset of the state at a particular point in time), its referencing the current content of the page as grounding for the response to a user request.