News for hackers. Stuff that matters.
Re:Show HN: Docker/Model-Runner – Join Us in Revitalizing th... by ericcurtin on Tuesday October 21, 2025 @10:57AM (#45656621)
Hi everyone, we're the maintainers.

We're rebooting the model-runner community and wanted to share what we've been up to and where we're headed.

When we first built this, the idea was simple: make running local models as easy as running containers. You get a consistent interface to download and run models from different backends (llama.cpp being a key one) and can even transport them using familiar OCI registries like Docker Hub.

Recently, we've invested a lot of effort into making it a true community project. A few highlights:

- The project is now a monorepo, making it much easier for new contributors to find their way around.

- We've added Vulkan support to open things up for AMD and other non-NVIDIA GPUs.

- We made sure we have day-0 support for the latest NVIDIA DGX hardware.

- There is a new "docker model run" UX: https://www.docker.com/blog/docker-model-run-prompt/

Re:Show HN: Docker/Model-Runner – Join Us in Revitalizing th... by doringeman on Tuesday October 21, 2025 @11:20AM (#45656923)
Hi everyone, another maintainer here.

Moreover, vLLM support is coming this week!