Re:Harnessing the Universal Geometry of Embeddings
by jxmorris12 on Wednesday May 21, 2025 @04:16PM
(#44055850)
Yeah, we didn't get around to testing what the impact would be of having a small amount of aligned data. I've seen other papers asserting that as few as five pairs is enough to go a long way.
All the best.
I can totally understand the professors point, little bit of alignment data ought significantly increase the chance of success. Otherwise it will have to rely on these small deviations from symmetry to anchor the orientation.