Re:Web Scraping as a Service
by bellwether on Sunday July 21, 2013 @12:29PM
(#6079298)
true, alternating IPs are useful, except when you already have agreements to do the scraping with the target site, which we do.
so what would interest me is something that made scraping easier or more robust. so far, it looks like the service still has some growing to do before it gets there.
The alternating IP is actually a bit of a big deal, it's kind of a pain to run your own proxies and have to manage the proxy switching yourself (so painful that I would pay 10 bucks/month for someone else to do it for me)