News for hackers. Stuff that matters.

A comment on Brave Search beta. Parent comment

Re:Brave Search beta by ocdtrekkie on Wednesday June 23, 2021 @12:29AM (#27600802)
While scraping search results isn't illegal, by any means, it's also not illegal for Google or Microsoft to block requests they believe are from competing search engines. Presumably the cost of paying them is less than the cost of hiring engineers to constantly try to find new ways to outwit Google and Microsoft engineers.

Again, if scraping data from websites without permission, Google simply wouldn't exist. Bear in mind, robots.txt is a feature that Google and Microsoft choose to respect, but the default assumption search engines have made from the beginning, is that they are free to grab whatever they want from the web, unless you ask them otherwise to please not.

[ Parent | on HN ]
Re:Brave Search beta by lern_too_spel on Wednesday June 23, 2021 @01:39AM (#27601121)
> the default assumption search engines have made from the beginning, is that they are free to grab whatever they want from the web, unless you ask them otherwise to please not.

Which Google's robots.txt does.

> scraping search results isn't illegal, by any means

While scraping the results for yourself to look at might be OK, scraping results to display verbatim in another search engine without permission stretches fair use.

[ Parent | on HN ]
Re:Brave Search beta by ocdtrekkie on Wednesday June 23, 2021 @08:08AM (#27603483)
> While scraping the results for yourself to look at might be OK, scraping results to display verbatim in another search engine without permission stretches fair use.

No, it doesn't, because Google results aren't copyrightable, hence, there is no such thing as fair use. It's just information anyone is free to collect and use as they see fit.

[ Parent | on HN ]
Re:Brave Search beta by lern_too_spel on Wednesday June 23, 2021 @10:34AM (#27605020)
Why would rankings not be copyrightable?
[ Parent | on HN ]
Re:Brave Search beta by ocdtrekkie on Wednesday June 23, 2021 @07:04PM (#27611676)
Why would they be? Again, if all things being copyrightable by default, Google could not even exist, they assume they have the right to consume any data they want.

If a monkey can't copyright a selfie because they're not a person, an algorithmically generated spew of stuff Google ripped from elsewhere certainly lacks merit for copyright.

[ Parent | on HN ]
Re:Brave Search beta by lern_too_spel on Thursday June 24, 2021 @03:34AM (#27614875)
All things are copyrighted by default. Once again, those websites grant a license to search engines to consume their content via robots.txt, and Google does not.
[ Parent | on HN ]