News for hackers. Stuff that matters.
Re:First Personal Search Engine Prototype by viraptor on Saturday December 30, 2023 @09:26PM (#38821213)
I've been trying to do something similar for a while now. In the past I tried using YaCy in private mode, scraping a few aggregators and RSS feeds I read +2 levels of links. That was cool, but YaCy is practically dead these days and has various issues. Currently I'm trying ArchiveBox for the extraction + storage and poking around importing the results into Verba for RAG-style search using the local model of mixtral. ArchiveBox is nice in that it can do the text extractions from different types of media through a number of plugins. It's early days, but I think that's got a future.
Re:First Personal Search Engine Prototype by dennisy on Sunday December 31, 2023 @08:03AM (#38823783)
I am working on pretty much exactly this same thing :)

Anything you can share yet?

Here is mine: https://github.com/ydennisy/kg1

Re:First Personal Search Engine Prototype by rcarmo on Sunday December 31, 2023 @08:51AM (#38824017)
Yep. ArchiveBox here too. Am poking at the same problem, using a variety of RAG prompts.