News for hackers. Stuff that matters.

A comment on Avoiding Webscraping Throttling Using Python and Tor as a Proxy. Parent comment

Re:Avoiding Webscraping Throttling Using Python and Tor as a... by jacquesm on Sunday July 14, 2019 @02:14AM (#20431941)
The world is a lot larger than just the United States. Besides that, even publicly available information can be copyrighted. So the scraping itself may be legal, storing that information; using it and re-publishing it very likely is not.
[ Parent | on HN ]
Re:Avoiding Webscraping Throttling Using Python and Tor as a... by luckylion on Sunday July 14, 2019 @02:28AM (#20431985)
> The world is a lot larger than just the United States.

Where would this be significantly different? For T&C to be valid, you'll have to agree to them before using the service. Since you generally can't know, much less agree to, the T&C of a website before using that website, you have a chicken & egg problem where the law tends to come down on "these T&C aren't binding" imho.

You're right about the re-publishing though. Storing is likely a different issue, even browser-caching is storing; iirc there were court decisions in Germany that essentially argued that even having data in memory is creating a copy.

[ Parent | on HN ]
Re:Avoiding Webscraping Throttling Using Python and Tor as a... by aw3c2 on Sunday July 14, 2019 @05:35AM (#20432585)
In Germany there was a recent ruling that scraping, even for competing purposes, is fine.

https://www.heise.de/newsticker/meldung/Urteil-zu-Screen-Scr...

[ Parent | on HN ]
Re:Avoiding Webscraping Throttling Using Python and Tor as a... by thom on Sunday July 14, 2019 @05:08AM (#20432499)
In the EU there is the concept of ‘database rights’ which protects your investment creating and publishing large datasets. This legislation has nothing to do with site T&Cs.
[ Parent | on HN ]
Re:Avoiding Webscraping Throttling Using Python and Tor as a... by jacquesm on Sunday July 14, 2019 @04:10AM (#20432340)
> iirc there were court decisions in Germany that essentially argued that even having data in memory is creating a copy

My point exactly.

[ Parent | on HN ]