News for hackers. Stuff that matters.
Re:Show HN: I modeled the Voynich Manuscript with SBERT to t... by brig90 on Sunday May 18, 2025 @01:04PM (#44022749)
Totally fair — I defaulted to paraphrase-multilingual-MiniLM-L12-v2 mostly for speed and wide compatibility, but you’re right that it’s long in the tooth by today’s standards. I’d be really curious to see how something like all-mpnet-base-v2 or even text-embedding-ada-002 would behave, especially if we keep the suffixes in and lean into full contextual embeddings rather than reducing to root forms.

Appreciate you calling that out — that’s a great push toward iteration.

Re:Show HN: I modeled the Voynich Manuscript with SBERT to t... by Ey7NFZ3P0nzAe on Friday May 23, 2025 @01:41AM (#44070184)
Be careful: they have super short context length AND silently crop if the text is too long. To me there is really no reason to use them.

I recommend ollama to run the artic-embed-v2 model, it also is multimingual and you can use --quantize when loading the modelfile to get it even smaller.