News for hackers. Stuff that matters.

A comment on Go library for in-process vector search and embeddings with llama.cpp. Parent comment

Re:Go library for in-process vector search and embeddings wi... by PhilippGille on Wednesday October 30, 2024 @03:58PM (#41999524)
Yes I'm aware. I was contrasting the general use of an inference server vs calling llama.cpp directly (not via HTTP request).

And among servers Ollama seems to be more popular, so it's worth mentioning when talking about support for local LLMs.

[ Parent | on HN ]

There are no comments on this comment yet.