News for hackers. Stuff that matters.
Re:Nvidia on NixOS WSL – Ollama up 24/7 on your gaming PC by chpatrick on Friday April 11, 2025 @06:50AM (#43652467)
I use ChatGPT for most practical stuff but I really enjoy running local models. I find it really interesting and I think it's important for people to know how to run these without being beholden to big tech. If you have a used 3090 you can already run some really strong models. There are some really interesting local models as well, like the abliterated ones.

There are no comments on this comment yet.