Re:Web Scraping: How to Bypass Anti-Scraping Tools on Websites
by Eikon on Thursday December 26, 2019 @04:22AM
(#21882751)
> 8. EMPLOY A CAPTCHA SOLVING SERVICE
This is very unethical as there is real people involved behind this sort of operations. It’s not fancy algorithms but people freaking typing captchas all day.
By using captcha solving “services” you are often supporting slave-like working conditions.
Websites that make pure HTTP GET requests harder then just issuing a request make me sad. I do a fair bit of scraping for hobby projects (generally, archival stuff), and "protection" bullshit is just a giant pain in the ass.
I understand protections for things like posting content, commenting, etc.., but if you need to "protect" just viewing things, you are actively doing the internet wrong.
This is very unethical as there is real people involved behind this sort of operations. It’s not fancy algorithms but people freaking typing captchas all day.
By using captcha solving “services” you are often supporting slave-like working conditions.
Websites that make pure HTTP GET requests harder then just issuing a request make me sad. I do a fair bit of scraping for hobby projects (generally, archival stuff), and "protection" bullshit is just a giant pain in the ass.
I understand protections for things like posting content, commenting, etc.., but if you need to "protect" just viewing things, you are actively doing the internet wrong.