That doesn't mean it's good for the web, but "what (the most) users want" is Google's strong point. And this is par for the "the internet is now 4 websites" course, so I don't think it's possible to claim that this isn't "how the internet works" anymore.
People are not the memoryless automata that statistics handles best. People react positively to a bad change up to a point where they don't anymore, you don't even need to keep changing to trigger this.
Take a look outside your window. Have you understood quantum physics yet? No? I guess all of the available data doesn't help you, because it still requires effort and careful observation to glean insights from it.
The same goes for Google. Data by itself does not guarantee anything. You can look at a piece of data and not reach any conclusion, or reach the wrong conclusion. More data does not mean more insight.
In my field (biology) we are suddenly drowning in data - we are producing new datasets much faster than we can analyze them. Our understanding is not increasing at a commensurate pace because we lack the ability to turn these data into useful knowledge.
I still think Google today isn’t as good as Google 10+ years ago, but I don’t think anything is as good as Google 10+ years ago. They don’t have to be flawless, they just have to be better than the rest, and they are. I settle for DuckDuckGo when I can, but when the results matter, I’ll still end up using Google.
Data is the most valuable commodity today. The mountain of data and network effects Google has cultivated ensure they will remain on top for the foreseeable future. It's similar to the crazy expensive industrial supply chains that manufacturers in the past leaned on to maintain their market position. No other company (outside maybe Facebook/Amazon) has that kind of a data moat.
Bing: https://www.bing.com/search?q=do+i+have+to+turn+in+everythin...
Google: https://www.google.com/search?q=do+i+have+to+turn+in+everyth...
Funny thing is that I moved to DDG because Google couldn't reliably guess my answers, and I am satisfied with an engine that tries to guess to a much larger extent. This is because DDG guesses are better, and they don't hide the web results so I can fall back to them.
0: https://goo.gl/search/right+rectangular+pyramid+calc:+find+A