News for hackers. Stuff that matters.
Re:What Are Embeddings? by teruakohatu on Sunday June 25, 2023 @09:32PM (#36474663)
^^^ this is a really succinct explanation. I would just add that an embedding is an array/vector of numbers. Does not have to be floats although they are in practice.

The magic is creating the embedding, embeddings themselves are nothing special.

Re:What Are Embeddings? by specproc on Monday June 26, 2023 @05:55AM (#36477696)
Yeah, I'd been working with them for ages before I really wrapped my head around the sausage machine. There was a Wolfram blog a while back that really helped me grok it [0]. The last state of a neural network prior to prediction, if I understand correctly.

[0] https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...