Re:Docker Model Runner
by mappu on Sunday April 13, 2025 @10:31PM
(#43677560)
All that work (AGX acceleration...) is done in llama.cpp, not ollama. Ollama's raison d'être is a docker-style frontend to llama.cpp, so it makes sense that Docker would encroach from that angle.
[ Parent
| on HN ]
There are no comments on this comment yet.