High-performance .NET by example: Filtering bot traffic

Re:High-performance .NET by example: Filtering bot traffic by brilliantcode on Monday April 24, 2017 @12:20PM (#14185540)

what if the "grey" traffic came from residential IP addresses using a normally distributed range of user agents? How would you reliable distinguish them from regular traffic?

[ Parent | on HN ]

Re:High-performance .NET by example: Filtering bot traffic by Benfromparis on Monday April 24, 2017 @01:04PM (#14185970)

Basically, we are using two sort of technics : technical and behavior.

Technical : if the UserAgent claim to be a regular browser (let say Chrome 43) we will check on network level if the client implement http protocol like Chrome 43 usually do and on the JS side if the Javascript render is correct for Chrome. In case it's a real Chrome, we will check if the Browser is controlled by automation Tool.

Behavior : we will check if the path of requests is regular according to the website usage.

Disclaimer: I'm working at https://datadome.co, a bot protection tool.

[ Parent | on HN ]

Re:High-performance .NET by example: Filtering bot traffic by alexandrnikitin on Monday April 24, 2017 @01:07PM (#14185993)

It depends. Usually do nothing if that traffic is very low. There's no reliable way to do that. Honeypots and behavior analysis are very useful here.

[ Parent | on HN ]