News for hackers. Stuff that matters.
Re:Embeddings are a good starting point for the AI curious a... by lubesGordi on Thursday April 18, 2024 @09:25AM (#40075964)
I think this is the point of the Attention portion in an llm, to use context to skew the embedding result closer to what youre looking for.

It does seem a little strange 'ruler' would be closer to 'king' versus something like 'crown'.

There are no comments on this comment yet.