Re:I Self-Hosted Llama 3.2 with Coolify on My Home Server
by dtquad on Wednesday October 16, 2024 @04:36AM
(#41856875)
I am using an old laptop with a GTX 1060 6 GB VRAM to run a home server with Ubuntu and Ollama. Because of quantization Ollama can run 7B/8B models on an 8 year old laptop GPU with 6 GB VRAM.
[ Parent
| on HN ]
There are no comments on this comment yet.