News for hackers. Stuff that matters.
Re:Embeddings are a good starting point for the AI curious a... by dvt on Wednesday April 17, 2024 @01:52PM (#40067993)
Yes, I use fastembed-rs[1] in a project I'm working on and it runs flawlessly. You can store the embeddings in any boring database (it's just an array of f32s at the end of the day). But for fast vector math (which you need for similarity search), a vector database is recommended, e.g. the pgvector[2] postgres extension.

[1] https://github.com/Anush008/fastembed-rs

[2] https://github.com/pgvector/pgvector

Re:Embeddings are a good starting point for the AI curious a... by J_Shelby_J on Wednesday April 17, 2024 @04:17PM (#40069608)
Fun timing!

I literally just published my first crate: candle_embed[1]

It uses Candle under the hood (the crate is more of a user friendly wrapper) and lets you use any model on HF like the new SoTA model from Snowflake[2].

[1] https://github.com/ShelbyJenkins/candle_embed [2] https://huggingface.co/Snowflake/snowflake-arctic-embed-l