How to detect web bots?

Re:How to detect web bots? by bryanrasmussen on Sunday February 09, 2020 @04:42PM (#22284515)

basically I've written bots for scraping governmental sites, and fashion sites. I've never yet had a problem (although the code on one fashion site looked like all classes were randomly generated with implied some attempt to keep scraping from working), so what I'm wondering is - what kinds of sites actually go through the trouble of tagging you as a bot, since you've got experience care to share?

[ Parent | on HN ]

Re:How to detect web bots? by forgotmypw on Sunday February 09, 2020 @09:27PM (#22285914)

Yandex Search does it to me regularly. Sometimes it takes 5 attempts to get through the captchas.

[ Parent | on HN ]

Re:How to detect web bots? by edoceo on Sunday February 09, 2020 @05:00PM (#22284621)

Ticketmaster

[ Parent | on HN ]

Re:How to detect web bots? by MonkeyIsNull on Sunday February 09, 2020 @05:25PM (#22284740)

Good response, I definitely never though of that before. Serious case where you don't want Bots buying stuff up.

[ Parent | on HN ]

Re:How to detect web bots? by edoceo on Sunday February 09, 2020 @05:39PM (#22284820)

Ages ago I was one of those bots. Most fun I've had playing cat-and-mouse. Their team was actually quite good. And I learned that Perl can solve any problem.

[ Parent | on HN ]

Re:How to detect web bots? by GrayTextIsTruth on Sunday February 09, 2020 @06:16PM (#22285012)

Have you written about this? Sounds like an entertaining story.

[ Parent | on HN ]

Re:How to detect web bots? by edoceo on Sunday February 09, 2020 @06:19PM (#22285026)

I have not. But I will and will post to HN.

[ Parent | on HN ]