Is there a way to run an LLM as a better local search engine?

Re:Is there a way to run an LLM as a better local search eng... by didgetmaster on Thursday June 19, 2025 @03:31PM (#44321775)

Local hard drive are big enough these days to hold hundreds of millions of files. That means that you could have many millions of each type of file (documents, pictures, spreadsheets, videos, etc.)

We need better ways to properly classify all that data with accurate metadata and quick ways to pick out a small subset of data for A.I. to analyze.

Databases were designed to do this with relational tables (e.g. find all customers from New York who bought our product in 2024); but file systems were not designed to do this with files (e.g. find all pictures I took with my phone in 2020).

A.I. can be a great tool to find patterns in files to answer important questions, but it will be incredibly slow if it has to analyze too many files for every query.

[ Parent | on HN ]

Re:Is there a way to run an LLM as a better local search eng... by oblio on Friday June 20, 2025 @05:55PM (#44332469)

The low level, file system, solution will probably not be widely implemented within my lifetime.

[ Parent | on HN ]

Re:Is there a way to run an LLM as a better local search eng... by didgetmaster on Saturday June 21, 2025 @10:14AM (#44337762)

Unfortunately, I tend to agree. I created a great solution (I think), but I am not Microsoft or Apple so getting any traction for it is incredibly hard.

[ Parent | on HN ]