Re:13ft – A site similar to 12ft.io but is self hosted
by 8organicbits on Monday August 19, 2024 @06:50PM
(#41295221)
Hmm, the robots.txt, IP blocking, and user agent blocking are all policies chosen by the web server hosting the data. If web admins choose to block Google competitors, I'm not sure that's on Google. Can you clarify?
[ Parent
| on HN ]
Re:13ft – A site similar to 12ft.io but is self hosted
by GreenWatermelon on Monday August 19, 2024 @06:57PM
(#41295269)
A nice example is the recent reddit-google deal which gives google' crawler exclusive access to reddit's data. This just serves to give google a competitive advantage over other search engine.
Re:13ft – A site similar to 12ft.io but is self hosted
by sroussey on Monday August 19, 2024 @08:06PM
(#41295582)
Nope. That deal was for AI not search.
Re:13ft – A site similar to 12ft.io but is self hosted
by darkwater on Monday August 19, 2024 @09:32PM
(#41296013)
Antitrust kicks in exactly in cases like this: using your moat in one market (search) to win another market (AI)
Re:13ft – A site similar to 12ft.io but is self hosted
by dns_snek on Tuesday August 20, 2024 @04:42AM
(#41298086)
This is false, the deal cuts all other search engines off from accessing Reddit. Go to Bing and search for "news site:reddit.com" and filter results by date from the past week - 0 results.
https://www.404media.co/google-is-the-only-search-engine-tha...
Re:13ft – A site similar to 12ft.io but is self hosted
by wahnfrieden on Tuesday August 20, 2024 @09:01AM
(#41299683)
What do you think search is
Re:13ft – A site similar to 12ft.io but is self hosted
by not2b on Monday August 19, 2024 @08:04PM
(#41295574)
Well yes, the Reddit-Google deal might be found to violate antitrust. Probably will, because it is so blatantly anticompetitive. But if a publication decides to give special access to search engines so they can enforce their paywall but still be findable by search, I don't think the regulators would worry about that, provided that there's a way for competing search engines to get the same access.
Re:13ft – A site similar to 12ft.io but is self hosted
by arrosenberg on Monday August 19, 2024 @08:31PM
(#41295696)
Which is it? Regulators shouldn’t worry, or we need regulations to ensure equal access to the market?
Re:13ft – A site similar to 12ft.io but is self hosted
by immibis on Tuesday August 20, 2024 @06:48AM
(#41298755)
regulators wouldn't worry if all search engines had equal access, even if you didn't because you're not a search engine
Re:13ft – A site similar to 12ft.io but is self hosted
by arrosenberg on Tuesday August 20, 2024 @10:35AM
(#41300470)
And if I had wheels, I would be a car. Theres no equal access without regulation.