News for hackers. Stuff that matters.
Re:Is there a way to run an LLM as a better local search eng... by aliasmaya on Wednesday June 18, 2025 @04:10AM (#44307724)
Seems that you're looking for a RAG System, and you may have a try RAGFlow
Re:Is there a way to run an LLM as a better local search eng... by oblio on Wednesday June 18, 2025 @06:47AM (#44308682)
Interesting, I had found Paperless:

https://github.com/icereed/paperless-gpt

https://docs.paperless-ngx.com/#features

These options seem far from... user friendly. Another concern is resource usage, I wonder how low LLMs will go (especially as far RAM and GPU requirements are concerned).