Re:New LLM optimization technique slashes memory costs up to...
by solarkraft on Tuesday December 17, 2024 @09:05AM
(#42441410)
With llama3.2:1b, llama3.2:3b and llama 3.1:8b being the main ones I tried and found impressive.
https://ollama.com/