News for hackers. Stuff that matters.
Re:What Are Embeddings? by chenghuzi on Monday June 26, 2023 @12:43AM (#36475802)
Not just similarity. It also includes all other possible relationships if you want, such as order, connectivity, etc.
Re:What Are Embeddings? by pedrosorio on Monday June 26, 2023 @01:33AM (#36476055)
What is order/connectivity in R^n?
Re:What Are Embeddings? by chenghuzi on Wednesday June 28, 2023 @11:12PM (#36515891)
It's pretty arbitrary. For example, you can define order as the product of all order relationships along each single dimension (binary product). As for connectivity, they can also be defined as boolean functions under certain radius, like the persistent homology spectrum.
Re:What Are Embeddings? by TeMPOraL on Monday June 26, 2023 @04:52AM (#36477332)
I'd say similarity, but any and all kinds of similarity you could ever think of - as long as you have enough dimensions and training data to feed it.

My current belief is that a hundred thousand+ dimensional latent space, as in SOTA LLMs, seems to have enough dimensions to reduce a large array of cognitive skills into a proximity search.