Re:LLM Embeddings Explained: A Visual and Intuitive Guide
by TZubiri on Monday July 28, 2025 @12:40PM
(#44712552)
Can't you decode the embeddings to tokens for debugging?
[ Parent
| on HN ]
Re:LLM Embeddings Explained: A Visual and Intuitive Guide
by freeone3000 on Monday July 28, 2025 @12:46PM
(#44712623)
You can but this is lossy (as it drops context; it’s a dimensionality reduction from 512 or 1024 to a few bytes) and non-reconvertible.