The pre-www search engines (gopher, Archie, jughead) were pretty sophisticated by allowing you to combine search expressions “and, or, near, phrase”, in essentially a regex style fashion, and they were getting better and better. Early www search engines followed the same approach, operating in the way that some library catalog systems still do. The problem is that they were easily gamed by bad actors.
This wasn’t an issue for some time, but the very instant making money become a possibility on the internet, everything changed. People remember google trouncing Altavista, but this was the broken Altavista that couldn’t defend against the scammers. The war had been going on for some time by then, with search engines starting well and failing once their weaknesses were discovered and exploited.
That google “topic + reddit” is now a thing says to me that the gamers have again won, and a new search approach is needed.
There's absolutely nothing available for my day job online, so you could say I've been living without Google for a decade. It's not as tough as you'd think. You just have to remember some basic syntax in your head or write it down in your notes, and look up APIs when you use them.
It doesn't honestly take much longer to do something sans-Google at work than it does to cobble web stuff together with Google and StackOverflow's help. It's OK
Certainly not everything is on the web with or without paywalls. And, as when I was doing software development at night pre-web, I could just have a library of books. But for a lot of things, you made do with taking longer, being more shallow, and making more mistakes.
Whether Google results of 1998 were worse in some measures than Google results of 2023 doesn't say much about whether "giving great search" gave people a super power that they didn't have before. I think it did (though I agree that someone else would have eventually done so, obviously).