News for hackers. Stuff that matters.

A comment on Web scraping is legal, US appeals court reaffirms. Parent comment

Re:Web scraping is legal, US appeals court reaffirms by CWuestefeld on Monday April 18, 2022 @04:25PM (#31076006)
Yes. And if I could get the perpetrators to raise their hands so I could work out an API for them, it would be the path of least resistance. But they take great pains to be anonymous, although I know from circumstantial evidence that at least a good chunk of it is various competitors (or services acting on behalf of competitors) scraping price data.

IANAL, but I also wonder if, given that I'd be designing something specifically for competitors to query our prices in order to adjust their own prices, this would constitute some form of illegal collusion.

[ Parent | on HN ]
Re:Web scraping is legal, US appeals court reaffirms by marginalia_nu on Monday April 18, 2022 @04:35PM (#31076134)
What seems to actually work is to identify the bots and instead of giving up your hand by blocking them, to quietly poison the data. Critically, it needs to be subtle enough that it's not immediately obvious the data is manipulated. It should look like a plausible response, only with some random changes.
[ Parent | on HN ]