Ask HN: Self hosted open source solutions for creating text embeddings?

Posted by WolfOliver on Saturday May 27, 2023 @02:40PM
from the ask-hn dept.

( 2 comments | on HN )

Re:Ask HN: Self hosted open source solutions for creating te... by beachandbyte on Saturday May 27, 2023 @03:00PM (#36097257)

[ Parent | on HN ]

Re:Ask HN: Self hosted open source solutions for creating te... by OthmaneHamzaoui on Sunday May 28, 2023 @12:44PM (#36105660)

For text based open-source models I would start looking in the HuggingFace Models hub (https://huggingface.co/models) and filter on "Feature extraction". Here is an example (https://huggingface.co/sentence-transformers/all-MiniLM-L6-v...). What do you plan to do with the embeddings once created?

For hosting solutions that depends on the traffic you're expecting. Is this just for testing or you have a level of traffic in mind?

[ Parent | on HN ]