> We don't know if the task is impossible because Google has no incentive to do it at all,

On the other hand, they have an incentive - increased competition, they can still monetize better pages, search is what makes them money.

Build a better mouse trap etc, if the task was possible, DDG / Bing / Whoever could absolutely dominate the search market by providing a ”no crap results” option

Kagi is trying to build a better mouse trap. I quite like it. Open beta is coming along with subscription model. I will be a subscriber.

They would only bother to try if they could monetize it, and the only model for that which won't create the same incentives is paid user subscriptions. The market for that may just be way to small for the big guys to consider.

I wonder how hard would it be to create ML algorithms that can classify something as crappy content. I am pretty sure it should be quite doable.

Check out Neeva. This is what we are all about.