Re:New LLM optimization technique slashes memory costs up to...
by gavmor on Tuesday December 17, 2024 @06:35PM
(#42446623)
I run ollama off a symlink to an external volume. It just feels neater that way, and can run any GGUF off of HuggingFace. I would like to know what configuration I'm missing out on, though.
[ Parent
| on HN ]
There are no comments on this comment yet.