Re:Don't use cosine similarity carelessly
by pooyak on Tuesday January 14, 2025 @06:35PM
(#42705455)
Very interesting article. Is there any model that can generate embeddings given a system prompt? This can be useful not only for similarity searching but also for clustering use cases without having to do too much custom work. Essentially, a zero shot embedding model.
[ Parent
| on HN ]
Re:Don't use cosine similarity carelessly
by Loranubi on Tuesday January 14, 2025 @07:17PM
(#42705788)
There are many embedding models supporting instructions. https://huggingface.co/spaces/mteb/leaderboard
Re:Don't use cosine similarity carelessly
by petesergeant on Tuesday January 14, 2025 @07:15PM
(#42705770)
I may have missed the point of your question, but there are many generators of embeddings:
https://openai.com/index/new-embedding-models-and-api-update...