News for hackers. Stuff that matters.
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by davely on Friday January 31, 2025 @12:12PM (#42889447)
For what it's worth, HuggingFace provides documentation on how you can run any GGUF model inside Ollama[0]. You're not locked into their closed library or have to wait for them to add new models.

Granted, they could be a lot more helpful in providing information on how you do this. But this feature exists, at least.

[0] https://huggingface.co/docs/hub/en/ollama

There are no comments on this comment yet.