News for hackers. Stuff that matters.
Re:Ask HN: Anyone working on something better than LLMs? by exe34 on Friday May 10, 2024 @05:28PM (#40323958)
> understanding' simply means knowing a man is to a woman what a king is to a queen,

Turns out this is beautifully represented by embeddings alone!

Re:Ask HN: Anyone working on something better than LLMs? by xucian on Saturday May 11, 2024 @02:45PM (#40329878)
yes, I agree it's beautiful how basic vector addition/subtraction navigates you through some kind of meaning space, playing with relationships between things and such

actually, this is the same way in which the model in the Meaning space would operate too. so the process is similar, it's not like we're reinventing the whole wheel, but just that instead of referring to the words "king" and "queen" we'd refer to the actual concept of a king and queen, in a language-agnostic way, i.e. we wouldn't have to also embed their French translations "roi" and "reine" -- it'll be built-in, because a queen is a queen in most languages

I acknowledge there are differences even in fundamental concepts between countries/cultures, but it's not the norm. for example, in a language "to want" could just mean something passive, while in some language "to want" might also imply taking some action towards it. I'm aware about these, but I think they're just infrequent nuances (that have to be dealt with later)