News for hackers. Stuff that matters.
Re:The Super Effectiveness of Pokémon Embeddings Using Only ... by refulgentis on Sunday June 30, 2024 @08:38PM (#40841609)
Almost everyone uses MiniLM-L6-v2.

You almost certainly don't want to use MiniLM-L6-v2.

MiniLM-L6-V2 is for symmetric search: i.e. documents similar to the query text.

MiniLM-L6-V3 is for asymmetric search: i.e. documents that would have answers to the query text.

This is also an amazing lesson in...something: sentence-transformers spells this out, in their docs, over and over. Except never this directly: i.e. it has a doc on how to make a proper search pipeline, and a doc on the correct model for each type of search, but not a doc saying "hey use this"

And yet, I'd wager there's $100+M invested in vector DB startups who would be surprised to hear it.

Re:The Super Effectiveness of Pokémon Embeddings Using Only ... by radarsat1 on Monday July 01, 2024 @05:18AM (#40843995)
It would be nice if you spelled out on your post how you know this, then. Is it written somewhere? A relevant paper for example?
Re:The Super Effectiveness of Pokémon Embeddings Using Only ... by refulgentis on Monday July 01, 2024 @10:27AM (#40846153)
> it has a doc on how to make a proper search pipeline, and a doc on the correct model for each type of search, but not a doc saying "hey use this"