Re:Why the open social web matters now
by CaptainOfCoit on Sunday October 19, 2025 @08:42AM
(#45633745)
> - spam, which now includes scrapers bringing your site to a crawl
What do you mean with "now"? If you've ever been in a competitive industry before, you're already used to the random DDoS, and if you've published a moderately successful website, you've dealt with misbehaving scrapers/user-agents too, like the ones that get stuck and get requesting random 100 URLs per second for weeks.
I'm guessing you're alluding to AI scrapers, but are they really that different from what we've already learnt to deal with on the public internet?
What do you mean with "now"? If you've ever been in a competitive industry before, you're already used to the random DDoS, and if you've published a moderately successful website, you've dealt with misbehaving scrapers/user-agents too, like the ones that get stuck and get requesting random 100 URLs per second for weeks.
I'm guessing you're alluding to AI scrapers, but are they really that different from what we've already learnt to deal with on the public internet?