News for hackers. Stuff that matters.
Re:Building a Knowledge System That Enhances Rather Than Rep... by nsavage on Thursday January 02, 2025 @09:49PM (#42581756)
Author here. Glad I'm not the only one with this problem!

What I'm experimenting with is building a graph out of "entities", which I'm calling people, places and things found in each card. The point I guess is to allow the LLMs to make connections between cards, but this won't be replacing user made connections.

This lets me pick up all cards that reference something like, I don't know, "factories" as a concept, which isn't something the user will necessarily want to directly connect.

Downside is that deduplicated taxonomy: I have, from a scan through my list, "factories", "Factory" and "Factories". My attempt to head this off is by vector searching based on the proposed entity keywords and having an LLM decide if they are the same or not. I think I need to work on my prompt for this though.

Re:Building a Knowledge System That Enhances Rather Than Rep... by lukev on Thursday January 02, 2025 @11:01PM (#42582272)
I have a thesis that RDF is good for this sort of work (I gave a talk on it at Clojure Conj last year, https://youtu.be/OxzUjpihIH4 if you're interested.)

It's good for bridging the gaps between LLMs, ontologies, traditional structured data, and logic programming.

Re:Building a Knowledge System That Enhances Rather Than Rep... by ketedrum on Friday January 03, 2025 @12:35AM (#42582832)
Interesting, thank you! Gonna watch this asap
Re:Building a Knowledge System That Enhances Rather Than Rep... by uoaei on Friday January 03, 2025 @01:34AM (#42583132)
Do you know of any good RDF datasets or repositories to look for? I am familiar with linked data / semantic web but have not kept up on developments for a long while now.
Re:Building a Knowledge System That Enhances Rather Than Rep... by zozbot234 on Friday January 03, 2025 @07:45AM (#42585187)
You can refer to the Linked Open Data (LOD) cloud for a network of openly available RDF datasets. Wikidata currently serves as the unofficial "hub" for the cloud, a role that was formerly played by DBpedia.
Re:Building a Knowledge System That Enhances Rather Than Rep... by spothedog1 on Friday January 03, 2025 @01:21PM (#42588111)
yup I've been working on building a platform entirely built on RDF Ontologies. Excited to try to combine it with LLMs in the not-to-distant future.