News for hackers. Stuff that matters.
Re:Docker Model Runner by mappu on Sunday April 13, 2025 @10:31PM (#43677560)
All that work (AGX acceleration...) is done in llama.cpp, not ollama. Ollama's raison d'être is a docker-style frontend to llama.cpp, so it makes sense that Docker would encroach from that angle.

There are no comments on this comment yet.