News for hackers. Stuff that matters.
Re:GPU Embedding with GGML by cptcobalt on Monday October 16, 2023 @12:11PM (#37901959)
Ollama seems to be using a lot of the same, but as a really nice and easy to use wrapper for a lot of glue a lot of us would wind up writing anyway. It's quickly become my personal preference.

It looks to include submodules for GGML and GGUF from llama.cpp

https://github.com/jmorganca/ollama/tree/main/llm

There are no comments on this comment yet.