News for hackers. Stuff that matters.
Re:Show HN: I made a website to semantically search ArXiv pa... by bubaumba on Wednesday December 25, 2024 @11:14AM (#42509465)
Absolutely worth doing. Here is interesting related video, local RAG:

https://www.youtube.com/watch?v=bq1Plo2RhYI

I'm not an expert, but I'll do it for learning. Then open source if it works. As far as I understand this approach requires a vector database and LLM which doesn't have to be big. Technically it can be implemented as local web server. Should be easy to use, just type and get a sorted by relevance list.

Re:Show HN: I made a website to semantically search ArXiv pa... by Quizzical4230 on Wednesday December 25, 2024 @11:20AM (#42509500)
Perfect!

Although, atm I am only using retrieval without any LLM involved. Might try integrating if it significantly improves UX without compromising speeds.