Re:Avoiding bot detection: How to scrape the web without get...
by geysersam on Monday November 01, 2021 @02:26AM
(#29063600)
Interesting discussion.
To me it seems sending a http request is somewhere inbetween looking (legal) and entering (illegal if not permitted).
However, most important is that the web as a system makes positive interactions easy and negative difficult. We have already found some set of constraints achieving this for interactions in public city streets. But it's not obvious the same rules (that we have internalized) have the same effect in another medium of communication.
To me it seems sending a http request is somewhere inbetween looking (legal) and entering (illegal if not permitted).
However, most important is that the web as a system makes positive interactions easy and negative difficult. We have already found some set of constraints achieving this for interactions in public city streets. But it's not obvious the same rules (that we have internalized) have the same effect in another medium of communication.