News for hackers. Stuff that matters.
Re:Web Scraping in 2016 by rch on Tuesday August 23, 2016 @03:28PM (#12346728)
There is so much that's missing from this. What about gathering tokens from customers vs. paying for social data feeds? How about canned services like 80legs?
Re:Web Scraping in 2016 by franciskim on Tuesday August 23, 2016 @03:32PM (#12346767)
Hmm yeah there are a lot of other things that I could write about. 80legs seem like another Scrapy type of SaaS? Not sure what you mean about gathering tokens from customers.
Re:Web Scraping in 2016 by rch on Tuesday August 23, 2016 @04:26PM (#12347271)
I've heard of companies that scrape on behalf of customers who will walk marketing people through the process of creating an API token to help mitigate rate limiting.