News for hackers. Stuff that matters.

A comment on The Fathers of the Internet Urge Today’s Software Engineers to Reinvent the Web. Parent comment

Re:The Fathers of the Internet Urge Today’s Software Enginee... by brokenmachine on Sunday June 19, 2016 @08:16PM (#11935420)
Google built its business and its current $500+ billion status on stealing other websites' content and storing it on their servers.

Can't anyone exclude their pages from being scraped by google if they so desire?

If you post something on a site that allows itself to be scraped, only then it will go on google.

[ Parent | on HN ]
Re:The Fathers of the Internet Urge Today’s Software Enginee... by zAy0LfpBZLC8mAC on Monday June 20, 2016 @04:28AM (#11936772)
Practically, you can't, because Google has a quasi-monopoly on attention.

See also https://en.wikipedia.org/wiki/Network_effect

[ Parent | on HN ]
Re:The Fathers of the Internet Urge Today’s Software Enginee... by brokenmachine on Wednesday June 22, 2016 @07:37PM (#11957899)
My point was that it is misleading to say that Google is "stealing" content because they are only indexing pages that don't opt-out of being indexed.
[ Parent | on HN ]
Re:The Fathers of the Internet Urge Today’s Software Enginee... by Gracana on Monday June 20, 2016 @12:30AM (#11936054)
Or if anybody else posts anything about you on such a site.
[ Parent | on HN ]
Re:The Fathers of the Internet Urge Today’s Software Enginee... by Natanael_L on Monday June 20, 2016 @10:04AM (#11938075)
Trivially with robots.txt, which is standardized and so well known among anybody doing webservers that not having such a rule ought to be considered as consent.

About the same as the rule here in Sweden on filming - you're free to film in any private venue until told not to.

[ Parent | on HN ]