News for hackers. Stuff that matters.
Re:How to detect web bots? by zzzcpan on Sunday February 09, 2020 @02:02PM (#22283694)
I somewhat agree, but those can be good signals though, you just have to gather statistical data on them from known good users and combine with other signals. Like what are the chances for an agent to be used by a real person if it doesn't download images, lacks mouse movements and, for example, is coming from a datacenter? Obviously pretty low. The same way access patterns alone don't give you much, but are good against scrapers when combined with other signals.

And putting captchas or logins on anything you have to protect from bots also "protects" from real people, most of them simply leave and don't bother with those thing.

Re:How to detect web bots? by heavyset_go on Sunday February 09, 2020 @04:02PM (#22284280)
> Like what are the chances for an agent to be used by a real person if it doesn't download images, lacks mouse movements and, for example, is coming from a datacenter? Obviously pretty low.

Congrats, you just identified a visually impaired user with a screen reader who uses a VPN through AWS/GCP/etc.

Re:How to detect web bots? by zzzcpan on Sunday February 09, 2020 @04:23PM (#22284403)
And your point is?
Re:How to detect web bots? by bryanrasmussen on Sunday February 09, 2020 @04:38PM (#22284494)
that depending on your sites purpose and where your servers are located / where your main customer base is you might be opening yourself to extremely negative public relations by blocking this person as a bot, or even legal repercussions.
Re:How to detect web bots? by zzzcpan on Sunday February 09, 2020 @04:48PM (#22284555)
This is completely irrelevant to the conversation about technical solutions. My example is just about probabilities and how to use them for bot detection.
Re:How to detect web bots? by gregoryl on Sunday February 09, 2020 @06:14PM (#22284998)
If that logic is extended, the true technical solution is to turn the site off entirely.
Re:How to detect web bots? by zzzcpan on Sunday February 09, 2020 @06:53PM (#22285200)
What exactly in that logic in any way leads to turning off the site entirely? It's literally the opposite: narrowing down the bots by calculating probability of them not being real people using multiple signals and like Bayesian inference or something like that, it's pretty much a primitive machine learning.

I'm surprised there are so many trolling comments here.

Re:How to detect web bots? by bryanrasmussen on Monday February 10, 2020 @11:11AM (#22290331)
well if that was the case then the parent comment pointing out you could have had a false positive certainly seems relevant, but you wanted to know what their point was. I thought their point was just that these false positives could create negative consequences for anyone implementing a bot preventing solution on their site.
Re:How to detect web bots? by zzzcpan on Monday February 10, 2020 @11:29AM (#22290558)
In the context of describing an idea to minimize false positives, pointing out a false positive in the given example is at best nitpicking, it's definitely not relevant.
Re:How to detect web bots? by heavyset_go on Sunday February 09, 2020 @04:46PM (#22284545)
The ADA exists and for good reasons.