Re:Text Embeddings Reveal (Almost) as Much as Text
by jxmorris12 on Saturday October 14, 2023 @11:08AM
(#37881067)
To train a larger inversion model, I think we'll just need 16 A100s for a month or two. We can circle back in December, once the bigger model finishes training, to see that we've gotten better reconstruction performance. Fascinating!
Scaling is always both important and interesting.