News for hackers. Stuff that matters.
Re:Show HN: An extension to track your Wikipedia adventures by steezeburger on Thursday May 02, 2024 @01:45PM (#40239128)
I've been thinking of something like this since LLMs became popular. I've toyed around with some proof of concepts, but haven't had the time or motivation to work on it lately. I love the idea of tagging everything and showing connections when you're searching for things. Also semantic search would be great, like "blue website with information about databases I read last week" would be super powerful in my opinion.

I really love the idea of digital knowledge bases, but as you said, I think we're leaving a lot on the table. I need to get back to my project of a user-owned-data knowledge base.

Re:Show HN: An extension to track your Wikipedia adventures by jskherman on Thursday May 02, 2024 @01:55PM (#40239245)
What kind of approach did you take? I was thinking along the lines of requiring something like rewind.ai or some program that autoscreenshots your screen at a set interval (or originally a recorded video split into several images later) and having a vision-capable model (particularly specialized in UIs) describe these set of images in order to build a dataset of images-tags-description and the like.
Re:Show HN: An extension to track your Wikipedia adventures by jskherman on Thursday May 02, 2024 @01:57PM (#40239285)
There's also libraries like trafilatura in Python featured here in HN some time ago that could extract content from websites to help augment the data.