Re:FOSS infrastructure is under attack by AI companies
by RobKohr on Thursday March 20, 2025 @11:32AM
(#43424706)
Yep, just make sure to add them to your robots.txt file so that only the bad robots are harmed.
[ Parent
| on HN ]
Re:FOSS infrastructure is under attack by AI companies
by ethan_smith on Thursday March 20, 2025 @01:41PM
(#43426352)
Temporary solution and only works if only some of us are doing it. What if these bots have a "manager" LLM agent that takes the decision on what pages to scrape?