Embeddings Are Underrated

Re:Embeddings Are Underrated by tomthe on Friday November 01, 2024 @05:29AM (#42015282)

Nice introduction, but I think that ranking the models purely by their input token limits is not a useful exercise. Looking at the MTEB leaderboard is better (although a lot of the models are probably overfitting to their test set).

This is a good time to chill for my visualization of 5 Millionembeddings of HN posts, users and comments: https://tomthe.github.io/hackmap/

[ Parent | on HN ]

Re:Embeddings Are Underrated by kaycebasques on Friday November 01, 2024 @10:12AM (#42017068)

Thanks, a couple other people gave me this same feedback in another comment thread and it definitely makes sense not to overindex on input token size. Will update that section in a bit.

[ Parent | on HN ]