Re:Embeddings are a good starting point for the AI curious a...
by jmorgan on Wednesday April 17, 2024 @02:21PM
(#40068337)
Support for _some_ embedding models works in Ollama (and llama.cpp - Bert models specifically)
Embedding models run quite well even on CPU since they are smaller models. There are other implementations with a library form factor like transformers.js https://xenova.github.io/transformers.js/ and sentence-transformers https://pypi.org/project/sentence-transformers/
[ Parent
| on HN ]
There are no comments on this comment yet.