News for hackers. Stuff that matters.
Re:Ask HN: What's your current AI agentic setup? by ontouchstart on Wednesday November 04, 2026 @10:14PM (#50374705)
I use a nix one-liner to run llama.cpp on M5.

``` nix run nixpkgs#llama-cpp -- server --models-dir models -m models/gemma-4-12B-it-Q8_0.gguf --port 8080 ```

open http://localhost:8080.

I also run pi in a docker container to do some vibe agentic coding. But I prefer `cat flake.nix | pbcopy` and paste into the browser. Then I can export the jsonl files and use tools to convert them to md and push to GitHub Pages.

I can do most of AI sessions off-line and only need hotspot to sync with GitHub.

My main use case is to learn and hack nix on Mac. It is fun.

There are no comments on this comment yet.