Re:Launch HN: Dashblock (YC S19) – Turn Any Website into an API
by reascenda on Wednesday September 18, 2019 @02:25PM
(#21008399)
This may now be moot after the LinkedIn Vs hiq labs case a couple of days ago which appears to have blanket legalised we scraping.
Re:Launch HN: Dashblock (YC S19) – Turn Any Website into an API
by kube-system on Wednesday September 18, 2019 @06:33PM
(#21011118)
hiQ v. LinkedIn means you probably aren't going to jail for scraping LinkedIn's website. It doesn't mean LinkedIn can't IP ban you.
Re:Launch HN: Dashblock (YC S19) – Turn Any Website into an API
by MCorbani on Wednesday September 18, 2019 @03:27PM
(#21009042)
Agreed, some websites are really reticent about scraping.
But let's think about Google, they are scraping the whole web regardless of the ToS of the websites, so it all boils down to one question : do you create value for the website owner ?
That's why we want to focus on use-cases where we create value for both, our users and the website owner. If you think about Yodlee/Plaid in the banking sector, they built partnerships with the Banks but continued scraping them because most of them didn't provide an API.
Re:Launch HN: Dashblock (YC S19) – Turn Any Website into an API
by kube-system on Wednesday September 18, 2019 @06:40PM
(#21011201)
Google respects robots.txt.
> We prohibit crawling, scraping, caching or otherwise accessing any content on the Service via automated means... [etc]