News for hackers. Stuff that matters.
Re:Token Embeddings Violate the Manifold Hypothesis by verdverm on Monday November 10, 2025 @04:51PM (#45881409)
If this interests you, https://bsky.app/profile/jefferyharrell.bsky.social has been making some super cool visualizations of Qwen3's internal representations

One thing discovered was that 800+ tokens converged to a single point in the 2500+ dimensional unembedding space

Some examples:

https://bsky.app/profile/jefferyharrell.bsky.social/post/3m4...

https://bsky.app/profile/jefferyharrell.bsky.social/post/3m5...

There are no comments on this comment yet.