News for hackers. Stuff that matters.
Re:New LLM optimization technique slashes memory costs up to... by gavmor on Tuesday December 17, 2024 @06:35PM (#42446623)
I run ollama off a symlink to an external volume. It just feels neater that way, and can run any GGUF off of HuggingFace. I would like to know what configuration I'm missing out on, though.

There are no comments on this comment yet.