News for hackers. Stuff that matters.
Re:Show HN: docker/model-runner – an open-source tool for lo... by juangcarmona on Tuesday October 14, 2025 @10:41AM (#45580655)
Really glad to see DMR getting "new life"... I’ve been experimenting with it for local agentic workloads (MAF, Google's ADK, cagent, Docker MCP, etc...) and it’s such a clean foundation...

A few things that could make it even more powerful (maybe some are out of your scope):

- Persistent model settings (context size, temperature, etc.) across restarts — right now it always resets to 4k, which breaks multi-turn agents. - HTTP/gRPC interface to let tools and frameworks talk to DMR directly, not only through the CLI. (Here the issue is on Docker MCP side, right?) - Simple config management (`docker model set` or `docker model config`) so we can tweak GPU, threads, precision, etc. predictably. (there are at least a couple of issues on this topic already...)

TBH, I love how fast the discussion evolved today.

Congrats and good luck with this. I'll try to help, promised!

Re:Show HN: docker/model-runner – an open-source tool for lo... by ericcurtin on Tuesday October 14, 2025 @10:59AM (#45580896)
Keep opening pull requests and issues, we need these things, you are right!