News for hackers. Stuff that matters.
Re:TurboQuant: Redefining AI efficiency with extreme compres... by mesuvash on Wednesday March 25, 2026 @09:17PM (#47525596)
That's actually correct and intentional. TurboQuant applies the same rotation matrix to every vector. The key insight is that any unit vector, when multiplied by a random orthogonal matrix, produces coordinates with a known distribution (Beta/arcsine in 2D, near-Gaussian in high-d). The randomness is in the matrix itself (generated once from a seed), not per-vector. Since the distribution is the same regardless of the input vector, a single precomputed quantization grid works for everything. I've updated the description to make this clearer.
Re:TurboQuant: Redefining AI efficiency with extreme compres... by Geee on Wednesday March 25, 2026 @10:03PM (#47525864)
Thanks. However, from this visualization it's not clear how the random rotation is beneficial. I guess it makes more sense on higher dimensional vectors.
Re:TurboQuant: Redefining AI efficiency with extreme compres... by mesuvash on Thursday March 26, 2026 @12:42AM (#47526701)
Yes, this is important in high dimension. But sadly, very hard to visualize. In 2d it looks like unnecessary.