You might have stumbled onto a practical and useful application of LLMs. Yahoo (or whoever) could crawl the web, categorise each page, and provide a genuine "Index".

Like in the back of a book, or an old subject based card catalogue ... Dewy-decimalise the web :)

I've always felt that an index by subject would be more useful than string-match based searching. Of course, the index might rank links within each sub-sub--sub-sub...category with something like the original page-rank.

Now if Yahoo (or whoever) could avoid the enshitification trap ... imagine what a fabulous resource that could be.