News for hackers. Stuff that matters.
Re:A polynomial autoencoder beats PCA on transformer embeddings by pleshkov on Saturday May 09, 2026 @06:18AM (#48073715)
The polynomial lift in this post originally came out of an unsuccessful experiment with hyperbolic embeddings. The idea was to embed corpora into a hyperbolic ball (anisotropic embeddings have a tree-like structure that hyperbolic space could exploit). The lift was a tool to go from hyperbolic latent back to Euclidean for retrieval. Hyperbolic part didn't work; the lift evaluated standalone kept showing real signal, and that became this post.

There are no comments on this comment yet.