Re:Show HN: CloudScrape – Cloud-based web scraping platform
by GPGPU on Saturday October 17, 2015 @09:32AM
(#10404313)
One of their features is "Automatic IP Address Rotation" so it may not be easy....
Re:Show HN: CloudScrape – Cloud-based web scraping platform
by toomuchtodo on Sunday October 18, 2015 @01:12AM
(#10407292)
Use their free tier to scrape your own honeypot site, log the traffic and use for blocking.
Wouldn't be hard to file abuse@ reports to their hosting provider as well. Just pipe their scrapper IPs into WHOIS.
Also, do they respect robots.txt? And how are they going to avoid being blocked by websites that don't want to be scraped? (I guess it would be easy to determine the IP addresses of their scrape robots).