Show HN: Apify – Turn any website into an API

Re:Show HN: Apify – Turn any website into an API by jakubbalada on Thursday October 26, 2017 @05:07PM (#15563017)

Typically depends on what you do with scraped data. There is an interesting recent US court ruling [1]

[1] http://www.reuters.com/article/us-microsoft-linkedin-ruling/...

[ Parent | on HN ]

Re:Show HN: Apify – Turn any website into an API by seanwilson on Thursday October 26, 2017 @08:16PM (#15564476)

If a court decides the usage wasn't legal, what's your liability as the service that provided the crawler?

[ Parent | on HN ]

Re:Show HN: Apify – Turn any website into an API by jancurn on Friday October 27, 2017 @04:23AM (#15566596)

We consider ourselves only as service providers. We provide technical means to perform the crawling but the responsibility for the actual crawling is with our users. It's similar to Amazon AWS - they only provide infrastructure and it's your responsibility not to use it for anything illeagal.

[ Parent | on HN ]

Re:Show HN: Apify – Turn any website into an API by seanwilson on Friday October 27, 2017 @05:53AM (#15566971)

Just curious but how to do enforce this assigning of responsibility? You make the user agree to terms of service before crawling?

[ Parent | on HN ]

Re:Show HN: Apify – Turn any website into an API by jancurn on Friday October 27, 2017 @07:23AM (#15567353)

Yes, every user has to agree with the Terms of use when signing up.

[ Parent | on HN ]

Re:Show HN: Apify – Turn any website into an API by breakingcups on Friday October 27, 2017 @10:10AM (#15568421)

How does that gel with features specifically aimed at cirumventing scrape-detection and blocking such as IP rotating?

[ Parent | on HN ]