News for hackers. Stuff that matters.
Re:Web scraping is legal, US appeals court reaffirms by userbinator on Monday April 18, 2022 @04:31PM (#31076085)
TLS fingerprinting is one of the ways minority browsers and OS setups get unfairly excluded. I have an intense hatred of Cloudflare for popularising that. Yes, there are ways around it, but I still don't think I should have to fight to use the user-agent I want.
Re:Web scraping is legal, US appeals court reaffirms by oh_sigh on Monday April 18, 2022 @04:36PM (#31076155)
I don't want to say tough cookies, but if OPs characterization isn't hyperbole("the lion's share of our operational costs are from needing to scale to handle the huge amount of bot traffic."), then it can be a situation where you have to choose between 1) cut off a huge chunk of bots, but upset a tiny percent of users, and improve the service for everyone else, or 2) simply not provide the service at all due to costs.
Re:Web scraping is legal, US appeals court reaffirms by nyuszika7h on Monday April 18, 2022 @06:19PM (#31077358)
I don't think it's likely to cause issues if implemented properly. Realistically you can't really build a list of "good" TLS fingerprints because there are a lot of different browser/device combinations, so in my experience most sites usually just block "bad" ones known to belong to popular request libraries and such.