News for hackers. Stuff that matters.
Re:Show HN: Crawlee for Python – a web scraping and browser ... by jancurn on Tuesday July 09, 2024 @11:18AM (#40917106)
There are many legitimate and legal use cases where one might want to circumvent blocking of bots. We believe that everyone has the moral right to access and fairly use non-personal publicly available data on the web the way they want, not just the way the publishers want them to. This is the core founding principle of the open web, which allowed the web to become what it is today.

BTW we continuously update this exhaustive post covering all legal aspects of web scraping: https://blog.apify.com/is-web-scraping-legal/

Re:Show HN: Crawlee for Python – a web scraping and browser ... by beeboobaa3 on Tuesday July 09, 2024 @12:53PM (#40918218)
Re:Show HN: Crawlee for Python – a web scraping and browser ... by mnmkng on Tuesday July 09, 2024 @01:45PM (#40918866)
It’s an “old” law that did not consider many intricacies of internet and the platforms that exist on it and it’s mostly made obsolete by EU case law, which has shrunk the definition of a protected database under this law so much that it’s practically inapplicable to web scraping.

(Not my opinion. I visited a major global law firm’s seminar on this topic a month ago and this is what they said.)