Re:What Are Embeddings?
by TeMPOraL on Monday June 26, 2023 @04:52AM
(#36477332)
I'd say similarity, but any and all kinds of similarity you could ever think of - as long as you have enough dimensions and training data to feed it.
My current belief is that a hundred thousand+ dimensional latent space, as in SOTA LLMs, seems to have enough dimensions to reduce a large array of cognitive skills into a proximity search.
My current belief is that a hundred thousand+ dimensional latent space, as in SOTA LLMs, seems to have enough dimensions to reduce a large array of cognitive skills into a proximity search.