Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Token Embeddings Violate the Manifold Hypothesis.
One thing discovered was that 800+ tokens converged to a single point in the 2500+ dimensional unembedding space
Some examples:
https://bsky.app/profile/jefferyharrell.bsky.social/post/3m4...
https://bsky.app/profile/jefferyharrell.bsky.social/post/3m5...
There are no comments on this comment yet.
One thing discovered was that 800+ tokens converged to a single point in the 2500+ dimensional unembedding space
Some examples:
https://bsky.app/profile/jefferyharrell.bsky.social/post/3m4...
https://bsky.app/profile/jefferyharrell.bsky.social/post/3m5...