You need another level of abstraction over the web to make discovery work, as you do with any application to make data useful. It's little different than making queries in a database.
Given that you're on Hacker News, it's likely your use case for the web isn't typical.
And let's not forget that if you have high quality content and submit your pages to Google, they will put you very high in the organic search results.
Fair enough, but I think the problem is the same regardless of the perspective. You as a webmaster wanting to be discovered and me as a user wanting to discover you implies an optimal interface between the two to facilitate that discovery.
Unfortunately, the web is no longer old fashioned. Most links are being posted to social media platforms or link aggregators like HN and Reddit. Most pages only link to other pages if it helps their SEO.
And unfortunately Google no longer ranks content based on quality because they sell rank space and because search is no longer about discovery so much as it is advertising. Which is why I think we do need search engines and algorithms, but we need the kind of search engines and algorithms we had when Google started and before they monetized search and before SEO ate everything when it actually did surface relevant content based on organic links.
I'm not arguing that hyperlinks don't solve the problem of discovery, just that they only solve it at a small scale, and we need a larger scale solution as well.
The problem isn't algorithms per se, but how those algorithms are implemented. Unfortunately, people coming up with alternatives tend to lean too far in the other direction - we have alternative search engines designed to exclude all sites using Javascript, for instance, which cater to people who don't want to interact with any part of the modern web, but we don't have an alternative that does what Google used to do before search became big business and simply attempt to catalog the entire web (including the parts that HN hates) and display relevant results to the end user.