Re:Show HN: I modeled the Voynich Manuscript with SBERT to t...
by brig90 on Sunday May 18, 2025 @01:04PM
(#44022749)
Totally fair — I defaulted to paraphrase-multilingual-MiniLM-L12-v2 mostly for speed and wide compatibility, but you’re right that it’s long in the tooth by today’s standards. I’d be really curious to see how something like all-mpnet-base-v2 or even text-embedding-ada-002 would behave, especially if we keep the suffixes in and lean into full contextual embeddings rather than reducing to root forms.
Appreciate you calling that out — that’s a great push toward iteration.
Re:Show HN: I modeled the Voynich Manuscript with SBERT to t...
by Ey7NFZ3P0nzAe on Friday May 23, 2025 @01:41AM
(#44070184)
Be careful: they have super short context length AND silently crop if the text is too long. To me there is really no reason to use them.
I recommend ollama to run the artic-embed-v2 model, it also is multimingual and you can use --quantize when loading the modelfile to get it even smaller.
The traditional NLP techniques of stripping suffices and POS identification may actually harm embedding quality than improvement, since that removes relevant contextual data from the global embedding.