Re:Spidermon: Scrapinghub’s Now Open Sourced Spider Monitori...
by appsonify on Tuesday March 05, 2019 @03:25PM
(#19313895)
that's totally not the same thing.
Re:Spidermon: Scrapinghub’s Now Open Sourced Spider Monitori...
by TheCowboy on Tuesday March 05, 2019 @03:45PM
(#19314064)
"Online-reviews firm Yelp Inc. alleged that Google is breaking a promise it made as part of a 2012 regulatory settlement to not scrape content from certain third-party sites including Yelp, escalating its yearslong battle against the search giant."
https://www.wsj.com/articles/google-rival-yelp-claims-search...
Re:Spidermon: Scrapinghub’s Now Open Sourced Spider Monitori...
by appsonify on Tuesday March 05, 2019 @04:15PM
(#19314325)
your point being? that has nothing to do with bypassing IP bans and defeating captcha. see 3taps vs craigslist ruling from EFF.
https://www.eff.org/deeplinks/2015/06/padmapper-and-3taps-se...
Re:Spidermon: Scrapinghub’s Now Open Sourced Spider Monitori...
by TheCowboy on Tuesday March 05, 2019 @04:23PM
(#19314382)
IP bans and captchas? This is moving the goalposts. You originally talked about violating Google's ToS.
[dead]
Re:Spidermon: Scrapinghub’s Now Open Sourced Spider Monitori...
by bigiain on Tuesday March 05, 2019 @05:55PM
(#19315020)
What's not so peculiar is that a 5 year old HN account with only 14 karma, and a profile that starts with
"Google has made our lives incredibly rich with knowledge and insight into our modern world. Google is the nicest monopoly out there and we should all support American corporations. I promise to defend Google from all attacks."
Is quite so insistent that web scraping a company that specialises in web scraping is inevitably such a bad thing...
It's quite obvious that at least one side of this discussion is a biased "fanboy" (as you put it)... I guess at least you're transparent about your stake in this matter in your profile...
It also ignores the fact that Google has scraped many sites to build its own profitable products and features over the years.