News for hackers. Stuff that matters.
Re:Embeddings are a good starting point for the AI curious a... by jmorgan on Wednesday April 17, 2024 @02:21PM (#40068337)
Support for _some_ embedding models works in Ollama (and llama.cpp - Bert models specifically)

  ollama pull all-minilm

  curl http://localhost:11434/api/embeddings -d '{
    "model": "all-minilm",
    "prompt": "Here is an article about llamas..."
  }'
Embedding models run quite well even on CPU since they are smaller models. There are other implementations with a library form factor like transformers.js https://xenova.github.io/transformers.js/ and sentence-transformers https://pypi.org/project/sentence-transformers/

There are no comments on this comment yet.