Re:Nvidia on NixOS WSL – Ollama up 24/7 on your gaming PC
by chpatrick on Friday April 11, 2025 @06:50AM
(#43652467)
I use ChatGPT for most practical stuff but I really enjoy running local models. I find it really interesting and I think it's important for people to know how to run these without being beholden to big tech. If you have a used 3090 you can already run some really strong models. There are some really interesting local models as well, like the abliterated ones.
[ Parent
| on HN ]
There are no comments on this comment yet.