News for hackers. Stuff that matters.
Re:The Theoretical Limitations of Embedding-Based Retrieval by faxipay349 on Sunday August 31, 2025 @10:27PM (#45088885)
Yeah, the standard SPLADE model trained from BERT typically already has a vocabulary/vector size of 30,552. If the SPLADE model is based on a multilingual version of BERT, such as mBERT or XLM-R, the vocabulary size could inherently expand to approximately 100,000, as does the vector size.

There are no comments on this comment yet.