News for hackers. Stuff that matters.

A comment on Avoiding bot detection: How to scrape the web without getting blocked?. Parent comment

Re:Avoiding bot detection: How to scrape the web without get... by Spivak on Monday November 01, 2021 @12:15PM (#29068794)
Why do you think it’s dishonest to send 403s to bots but not browsers? Method of access matters — you the human might have access to your safety deposit box but the bank is still allowed to make rules about your access — like you have to come during business hours and you can’t send someone on your behalf.
[ Parent | on HN ]
Re:Avoiding bot detection: How to scrape the web without get... by matheusmoreira on Tuesday November 02, 2021 @02:11PM (#29085178)
> you can’t send someone on your behalf

I totally can though. If sign a document saying another person can do such and such on my behalf, that person can totally do that. Yes, even at the bank. No different from a user agent, really.

[ Parent | on HN ]