News for hackers. Stuff that matters.
Re:Don't use cosine similarity carelessly by pooyak on Tuesday January 14, 2025 @06:35PM (#42705455)
Very interesting article. Is there any model that can generate embeddings given a system prompt? This can be useful not only for similarity searching but also for clustering use cases without having to do too much custom work. Essentially, a zero shot embedding model.
Re:Don't use cosine similarity carelessly by Loranubi on Tuesday January 14, 2025 @07:17PM (#42705788)
There are many embedding models supporting instructions. https://huggingface.co/spaces/mteb/leaderboard
Re:Don't use cosine similarity carelessly by petesergeant on Tuesday January 14, 2025 @07:15PM (#42705770)
I may have missed the point of your question, but there are many generators of embeddings:

https://openai.com/index/new-embedding-models-and-api-update...