Re:Llama.cpp supports Vulkan. why doesn't Ollama?
by davely on Friday January 31, 2025 @12:12PM
(#42889447)
For what it's worth, HuggingFace provides documentation on how you can run any GGUF model inside Ollama[0]. You're not locked into their closed library or have to wait for them to add new models.
Granted, they could be a lot more helpful in providing information on how you do this. But this feature exists, at least.
Granted, they could be a lot more helpful in providing information on how you do this. But this feature exists, at least.
[0] https://huggingface.co/docs/hub/en/ollama