News for hackers. Stuff that matters.
Re:I Self-Hosted Llama 3.2 with Coolify on My Home Server by dtquad on Wednesday October 16, 2024 @04:36AM (#41856875)
I am using an old laptop with a GTX 1060 6 GB VRAM to run a home server with Ubuntu and Ollama. Because of quantization Ollama can run 7B/8B models on an 8 year old laptop GPU with 6 GB VRAM.

There are no comments on this comment yet.