Re:EU Open Web Search project kicked off
by rgrieselhuber on Tuesday September 20, 2022 @04:03PM
(#32917031)
I index sites all the time and I think it could work. There will be other problems, of course, but we already are partly there with XML sitemaps. Relying on the large search engines to enforce “honesty” from websites puts them into a mediator role that has a number of negative effects both for search in general and, increasingly, society at large.
[ Parent
| on HN ]
Re:EU Open Web Search project kicked off
by kittiepryde on Tuesday September 20, 2022 @04:09PM
(#32917120)
Relying on sites to be honest about themselves, is even less likely. There are monetary incentives for many of them not to do that. Many sites host dishonest and clickbait content with extreme levels of SEO already. The cost of dishonesty decreases if you can directly modify the index.
Re:EU Open Web Search project kicked off
by rgrieselhuber on Tuesday September 20, 2022 @04:15PM
(#32917199)
I think that is primarily a symptom of the fact that we have a bottleneck on search interface providers. If it were easier / cheaper for new search engines / rankers to exist in the market, they could fairly easily filter out unscrupulous domains.